Display inserts, overlays, and graphical user interfaces for multimedia systems

ABSTRACT

A disclosed digital media device operational at user premises to receive media signals from a media source for presentation via endpoint devices such as a television display. The digital media device can include gateway and digital media management functionality and can be referred to as a gateway and digital media device. The device offers application services obtained over a wide area network and a user premises network. The digital media device may form a composite signal from the media signal and application service information, for example, for a composite audio and/or video signal for television type presentation to the user. The digital media device may receive a selection signal based on the presentation, for transmission to the application service provider device or to the media source. The media device also offers a GUI presenting a moveable arrangement of icons for selectively accessing application services.

INVENTION PRIORITY

This specification claims priority as a continuation application ofpatent application Ser. No. 12/521,760 for “Display Inserts, Overlays,and Graphical User Interfaces for Multimedia Systems”, filed May 28,2010, and issued as U.S. Pat. No. 8,397,264 on Mar. 12, 2013. Thespecification of the parent application Ser. No. 12/521,760 is herebyincorporated by reference.

FIELD OF THE INVENTION

The disclosed subject matter relates to gateways and digital mediadevices, programming for such devices, and media and servicedistribution systems to provide media signals from a media source andprovide application services from an application services deviceindependent of the media source, where the digital media device providesa composite signal to an audio-video system for an audio typepresentation, video type television presentation, or audio and videotype presentation. The disclosed subject matter also encompasses digitalmedia devices and/or programming thereof for offering a graphical userinterface (GUI) presenting a moveable arrangement of icons forselectively accessing application services.

BACKGROUND

The digital home is now becoming more complex with the myriad of new andemerging digital devices and services intended to address many user andconsumer needs such as communication, entertainment, privacy andsecurity, etc. However, given the complexity of the emerging digitalhome and digital environments generally, users who are technologicallychallenged may find it a daunting and intimidating task to integrate newdevices into their home network of interconnected digital devices.Additionally, users may find it difficult to integrate new servicesalong with their existing services such as in-home media sources,broadcast sources, Internet services from an Internet Services Provider(ISP), cable television services, etc. Often accompanying the newdevices and/or services are user interfaces for controllingfunctionality and delivery of applications and services. These newinterfaces typically have a different look and feel, thus compoundingthe daunting task of using the new devices and services.

Moreover, new paradigms are emerging oriented to delivering mediacontent to and the consuming of media content at the home. Many of theseparadigms rely on communication of application specific data to and/orfrom the Internet, as opposed to conventional telephone, broadcast videotype applications, or from in-home media sources such as Digital VideoRecorders (DVRs), Digital Video Disc (DVD) players, and the like.Furthermore, with respect to Internet based data, most of the contentdelivery solutions are provided to the digital home networks throughavailability of the “two-foot” interface (i.e., the PC). It isrelatively cumbersome to bring this Internet based data content to the“ten-foot” interlace (e.g., the television).

Increasingly, there is a need in a user home or similar digitalenvironment to interconnect and simplify the overall management ofapplication specific data devices with media content and other data toand/or from the Internet along with on-premises media sources, broadcastmedia sources, game console devices, and other home network devices witha common, dynamic Graphical User Interface (GUI) as may be presented ona television or audio-video system display. A further need exists tohave such a GUI be able to dynamically add applications, features, andfunctionality as a user adds or removes devices from the home network,or as they subscribe to various services. Such techniques or devicesshould reduce the complexity of the maintenance, upgrading, andoperation of even the more basic needs addressed by emerging digitalendpoint devices and networks. Current approaches that suggest greaterfunctionality in home-based appliances fail to reduce or address thecomplexity of managing and provisioning those appliances, especiallywith a common GUI presented over the “ten foot” interface, which may bedynamically change as devices, functionality, and services are added orremoved.

A further unmet need is for a combination of different content frommedia and/or application sources to be presented concurrently to a uservia a “ten-foot” interface. Accordingly, there is a need for a digitalmedia device inside the user premises to combine signals from variousmedia and/or application sources that are separate from one another, andprovide the combined signal to a television display or audio-videosystem for presentation to the user.

In that regard, it would be desirable to provide a digital media devicefor a user premises, or a media and service distribution system, thatprovides a composite of media and application services, IP-basedcommunication services, offers a centralized management capability forapplication services, and provides a dynamic GUI to access the media andapplication services.

SUMMARY

The technologies disclosed herein address one or more of the needsdiscussed above and provide improved results over existing technologies.The technology discussed herein may be embodied in a digital mediadevice, typically for deployment at the user premises, and/or toprogramming for devices that may function as digital media devices. Inaddition, the technology discussed herein may be embodied in media andservice distribution systems. The digital media devices, as well as themedia and service distribution systems, may be implemented in such amanner as to offer users a selection from a variety of media fromvarious media sources, as well as many independently providedapplication services, at the user premises. The applications offered viathe user's digital media device may be managed by a gateway type devicecapable of handling digital media and/or by a service management center.As described herein, one or more of the endpoint devices may be digitalmedia devices communicatively coupled to a television display or to anaudio-video system with a television type output.

In one example, a digital media device is communicatively coupled to atelevision display for operation at user premises. The digital mediadevice can include a first interface configured to receive a mediasignal from a media source for presentation via the television display.A second interface can be included that is configured to enablebi-directional communications between the digital media device and anapplication service provider device via a data communications link inthe user premises, where the application service provider device, whichis independent from the media source, is configured to provide anapplication service from a wide area network to the second interface ofthe digital media device via the user premises data communicationsnetwork. The digital media device includes a processor coupled to thefirst interface and the second interface, where the processor isconfigured to form a composite signal from the media signal andapplication service information from the provider device, where thecomposite signal comprises a composite image on the television display.The digital media device receives a selection signal based on thedisplayed image. The selection signal is transmitted via the userpremises data communications network to the application service providerdevice or to the media source.

The data communications link in the user premises may be a user premisesdata communications network.

The first interface of the digital media device may be configured toreceive the media signal from one or more media sources, where the mediasignal may be from an analog or digital video source. The media signalmay also be an audio signal, and the application service information mayprovide information for an audio signal. A composite signal may beformed from the media signal and the application service information.

The media signal of the composite signal formed by the digital mediadevice may be used to form from a primary image, and the applicationservice information of the composite signal may form a secondary image.Alternatively, the primary image may be formed from the applicationservice information, and the secondary image may be formed from themedia signal. A television display is configured to display thesecondary image overlaid on or inserted into the primary image to formthe composite image.

The detailed description provides an example of a media and servicedistribution system for a user premises having a media source to supplyto a media signal and a user premises data communications network. Themedia and service distribution system includes a gateway device foroperation at the user premises, independent of the media source,configured to receive an application service via a wide area network andfurther configured to provide and manage services to one or moreendpoint devices associated with the gateway device. The media andservice distribution system also includes a digital media devicecommunicatively coupled to a television display. The digital mediadevice can include a first interface configured to receive the mediasignal from the media source for presentation via the televisiondisplay. A second interface can be included with the digital mediadevice configured to enable bi-directional communications between thedigital media device and the gateway device coupled to the user premisesdata communications network, where the gateway device can be configuredto provide the application service from the wide area network to thesecond interface of the digital media device. The digital media devicealso includes a processor coupled to the first interface and the secondinterface. The processor is configured to form a composite signal fromthe media signal and application service information from the gatewaydevice, where the composite signal comprises a composite image on thetelevision display. The digital media device receives a selection signalbased on the displayed image, and where the selection signal istransmitted via the user premises data communications network to thegateway device or to the media source. It can be appreciated that thegateway device and digital media device can essentially operate as onegateway and digital media device in accordance with the teachingsherein. A combined system would include at least one interface tosupport communications with digital media providers and endpoint devicesover data networks (e.g., local and wide area networks).

The gateway device may be communicatively coupled to a servicemanagement center via the wide area network. In such a case, the gatewaymay be configured to provide the application service from the wide areanetwork to associated endpoint devices such as the combination of thedigital media device and television, responsive to a communication fromthe service management center.

The application service information from the gateway device may comprisenotifications of status with regard to one or more application servicesmanaged by the gateway device. The processor of the digital media devicemay receive the notifications of status from the gateway device andtransmit a message related to the selection signal the to the gatewaydevice, via the user premises data communications network, using apresence and networking protocol.

The gateway device may include a first interface for enablingbi-directional network layer communications on the user's side of thepremises with one or more of the associated endpoint devices. A secondinterface of the gateway device may enable bi-directional network layercommunications for the one or more endpoint devices via a wide areanetwork, and for enabling at least some bi-directional communicationswith a service management center external to the premises via the widearea network. A processor may be coupled to the interfaces, and storagecoupled to the processor. Programming may be embodied in the storage fora plurality of application services, where, for each applicationservice, execution of the programming by the processor causes thegateway device to provide functions in relation to a respective servicefor one or more endpoint devices. The programming embodied on thegateway device may further include logic for a plurality of applicationservices, logic for interfaces for the application services, includingat least one television interface for implementation on the televisiondisplay through the digital media device, logic for a servicesframework, and logic for platform management.

The detailed description provides an example of a digital media devicewith a specific programming architecture. The digital media deviceprovides graphical interaction with a media and service distributionsystem via a television display. The graphical interaction via thetelevision display includes arranging a first set of graphical icons ina pattern displayed on the television display, where the pattern has afirst end and a second end. The graphical icons may be arranged in asubstantially curved pattern or a substantially linear pattern. Thefirst end and the second end are each defined by a display edge of thetelevision display, and each graphical icon of the first set representsa media application, service application, or media and serviceapplication. The graphical interaction also includes highlighting one ofthe graphical icons of the first set, which is located substantially ata center of the pattern, so as to enable selection of the one graphicalicon. The digital media device receives a selection to move thearrangement icons in the pattern in a first direction or a seconddirection, so as to arrange a second set of graphical icons for displayon the television display in the pattern. One or more of the graphicalicons of the second set is different from one or more of the graphicalicons in the first set. Also, the rotation of the arrangement of thefirst set of icons to the second set of icons enables at least onegraphical icon of the first set to be rotated beyond the display edge,so as to no longer be visible on the television display. The graphicalinteraction also includes highlighting one of the second set ofgraphical icons located substantially at the center of the pattern toenable selection. The digital media device receives a selection of thehighlighted icon for at least one media application, serviceapplication, or media and service application. The graphical interactionalso includes displaying the selected media application, serviceapplication, or media and service application on the television display.

During the graphical interaction, the digital media device may receive aselection of the highlighted icon that enables the execution of theprogramming embodied on the digital media device to provide the selectedservice application from a gateway device through the digital mediadevice, via a user premises data communications network. Alternatively,receiving a selection of the highlighted icon may enable the executionof the programming embodied on the digital media device to provide aselected media application from a media source to the digital mediadevice.

The programming architecture of the digital media device may dynamicallyadd or dynamically remove one or more graphical icons from the firstplurality of graphical icons or the second plurality of graphical icons.The dynamic adding or removing of the one or more icons may bedetermined by subscriptions to media applications, service applications,or media and service applications.

The disclosure also encompasses program products for implementingdigital media devices of the type outlined above. In such a product, theprogramming is embodied in or carried on a machine-readable medium.

The detailed description also provides an example of a digital mediadevice communicatively coupled to an audio-video system for providing atelevision type output to a viewer at a user premises. The digital mediadevice includes a first interface configured to receive a media signalcontaining audio and video information, from a media source, fortelevision type presentation via the audio-video system. A secondinterface is configured to enable bi-directional communications betweenthe digital media device and an application service provider device viaa user premises data communications network, where the applicationservice provider device is independent from the media source. The secondinterface is also configured to receive information for an applicationservice offered from a wide area network from the application serviceprovider device via the user premises data communications network. Thesecond interface is also configured to send messages related to theapplication service via the user premises data communications network tothe application service provider device. The digital media deviceincludes a third interface configured to at least provide output to theaudio-video system. The digital media device also includes a processorcoupled to the first, second, and third interfaces. The processor isconfigured to form a composite signal containing audio and videoinformation, in response to the media signal and the receivedinformation for the application service. The processor supplies thecomposite signal for output via the third interface to the audio-videosystem for television type presentation. The processor is alsoconfigured to respond to a user selection signal based on the televisiontype presentation of the composite signal to cause the second interfaceto send a message related to a selection for the application service,via the second interface and the user premises data communicationsnetwork, to the application service provider device.

The detailed description also provides an example of a media and servicedistribution system for a user premises having a media source to supplyto media signal and a user premises data communications network. Themedia and service distribution system includes a gateway device foroperation at the user premises, independent of the media source,configured to receive an application service via a wide area network andfurther configured to provide and manage services to one or moreendpoint devices associated with the gateway device. The media andservice distribution system also includes a digital media devicecommunicatively coupled to an audio-video system for providing atelevision type output to a viewer at a user premises. The digital mediadevice includes a first interface configured to receive a media signalcontaining audio and video information, from a media source, fortelevision type presentation via the audio-video system. A secondinterface is configured to enable bi-directional communications betweenthe digital media device and an application service provider device viaa user premises data communications network. The application serviceprovider device is independent from the media source. The secondinterface is also configured to receive information for an applicationservice offered from a wide area network from the application serviceprovider device via the user premises data communications network. Also,the second interface is configured to send messages related to theapplication service via the user premises data communications network tothe application service provider device. The digital media deviceincludes a third interface configured to at least provide output to theaudio-video system the audio-video system. The digital media device alsoincludes a processor coupled to the first, second, and third interfaces.The processor is configured to form a composite signal containing audioand video information, in response to the media signal and the receivedinformation for the application service. The processor supplies thecomposite signal for output via the third interface to the audio-videosystem for television type presentation. The processor is alsoconfigured to respond to a user selection signal based on the televisiontype presentation of the composite signal to cause the second interfaceto send a message related to a selection for the application service,via the second interface and the user premises data communicationsnetwork, to the application service provider device.

Additional advantages and novel features will be set forth in part inthe description which follows, and in part will become apparent to thoseskilled in the art upon examination of the following and theaccompanying drawings or may be learned by production or operation ofthe examples. The advantages of the present teachings may be realizedand attained by practice or use of various aspects of the methodologies,instrumentalities and combinations set forth in the detailed examplesdiscussed below.

BRIEF DESCRIPTION OF THE FIGURES

The drawing figures depict one or more implementations in accord withthe present teachings, by way of example only, not by way of limitation.In the figures, like reference numerals refer to the same or similarelements.

FIG. 1 is a layered logical block diagram with arrows representing stepsof a sample logical flow, for an application client residing on adigital media device to access a specific managed application service,in a gateway device-service management center type networkconfiguration.

FIG. 2 illustrates a block diagram depicting a media and servicedistribution system.

FIG. 3 illustrates a functional block diagram of an exemplary digitalmedia device shown in FIG. 2.

FIG. 4 depicts a managed application services delivery platform.

FIG. 5 is a network diagram, depicting a gateway device, endpointdevices at the user premises, one or more wide area networks and aservice management center.

FIGS. 6A-6D depict the software and hardware architectures of themulti-services applications gateway device.

FIG. 7A illustrates a composite image of weather application serviceinformation overlaid onto a video display from a media source.

FIG. 7B illustrates received call application service informationoverlaid onto a video display from a media source.

FIG. 8A illustrates a graphical user interface depicting icons in asubstantially curved arrangement.

FIG. 8B illustrates a composite image of a graphical user interfacedepicting icons in a substantially linear arrangement overlaid onto avideo display from a media source.

FIG. 9A depicts an example Home screen page 700 for accessingapplications and/or services.

FIG. 9B depicts an example GUI Home Screen page 700 for accessingscratchpad functionality.

FIGS. 10A-10D depict exemplary GUI screen pages for accessing backupservices functionality.

FIGS. 11A-11B depict exemplary GUI screen pages for accessing appliancefile sharing services functionality.

FIGS. 12A-121 depict exemplary GUI screen pages for accessing appliancehome automation services functionality.

DETAILED DESCRIPTION

In the following detailed description, numerous specific details are setforth by way of examples in order to provide a thorough understanding ofthe relevant teachings. However, it should be apparent to those skilledin the art that the present teachings may be practiced without suchdetails. In other instances, well known methods, procedures, components,and circuitry have been described at a relatively high-level, withoutdetail, in order to avoid unnecessarily obscuring aspects of the presentteachings.

The technology discussed herein may be embodied in a digital mediadevice, typically for deployment at the user premises, and/or toprogramming for devices that may function as digital media devices.

In addition, the various technologies disclosed herein describe anapplication service provider device configured to offer its user many ofthe applications services, such as were previously offered fromnetwork-side servers, from the user premises. An exemplary applicationservice provider as discussed herein is a gateway device in the customerpremises having application service logic, where the gateway device isconfigured for communication with the digital media device(s) and/orwith other endpoint devices. The gateway device is implemented in such amanner as to offer its user many of the applications services, such aswere previously offered from network-side servers, from the userpremises. As further described below, these application servicescomprise, by way of example, programming to simplify support services inthe digital home including one or more of: media delivery, contentmanagement, access control and use tracking, file sharing, andprotection and back-up services of both Internet/Web-generated digitalmedia content and user generated digital media content. The gatewaydevice is programmed to simplify various aspects of managing theemerging home/business digital networks including the myriad ofinterconnected digital endpoint devices associated with the gatewaydevice. It is important to note that the endpoint devices need notreside within, or be located at, the premises to maintain theirassociation with the gateway device. One or more of the digital endpointdevices may be digital media devices in a user premises communicativelycoupled to a television display or to an audio-video system having atelevision type display, for implementing a user interlace to data basedapplication services provided through the gateway device and/or from oneor more media sources. In an exemplary embodiment, the digital mediadevice may communicate with the gateway device via a data communicationslink in the user premises. In an exemplary configuration, the digitalmedia device may be integrated with the gateway device.

The technology discussed herein may be embodied in media and servicedistribution systems, that may include gateway type devices andassociated digital media device, which provide application service logicin the customer premises. The media and service distribution systemsembodied herein may also include one or more media sources associatedwith the digital media device. Although based on a Client-Serverarchitecture, the exemplary gateway device and service management centermove substantial functions performed by the typical network server intothe user premises by incorporating those functions into the gatewaydevice, but in a way that allows for the server functionality to beexternally managed by the service management center from the networkside, which may be operated by a third-party service provider. In thisarchitecture, both the server functionality and the application servicesoffered via the gateway device to the digital media device may bemanaged by the service management center. Moreover, the server functionresiding in the gateway device is not only located in the premises butalso resides logically on the premises side of the Network ServiceProvider demarcation. The applications offered via the user's digitalmedia device in a media and service distribution system may be managedby a gateway type device or by a service management center.

The gateway device and the system architecture effectively place a setof application services on a tightly coupled (e.g., always-on oralways-available basis), secure hardware platform that is externallymanaged. A digital media device that is associated with the gatewaydevice in turn provides a user interface, e.g., for the “ten-foot”interface via a television and/or other audio-video system, for theapplication services. The gateway device comprises application servicesprogramming, and associated hardware, that is positioned on the userpremises side of the Network Service Provider Demarcation, which isconfigured to be managed by an external service management center. Thegateway device and the external service management center may provideapplication services to the digital media device positioned within theuser premises.

The digital media devices, as well as the media and service distributionsystems, may be implemented in such a manner as to offer users aselection from a variety of media from various media sources, as well asmany independently provided application services, from the userpremises.

Reference now is made in detail to the examples illustrated in theaccompanying drawings and discussed below. FIG. 1 is a high-leveldiagram of the architecture of the gateway-service management centernetwork as disclosed herein, as well as the logical flow of how aspecific Application Client residing at a User Premises could interactwith Application Service (AS) logic in a gateway device 10 that is beingmanaged in the gateway-service management center network configuration.Gateway device 10 in the example delivers a number of applicationservices to associated endpoint devices, including at least someendpoint devices within the premises. The associated endpoint devicesimplement Application Clients. For example, as shown in FIG. 1, one ormore specific Application Clients may reside on a digital media device35 within the user premises that may be communicatively coupled toaudio-video system 530. The Application Clients residing on digitalmedia device 35 may interact with a server functionality for anApplication Service, provided by the on-premises application servicelayer logic in a gateway device 10 to deliver applications and/orservices to audio-video system 530 in the user premises.

In the illustrated architecture shown in FIG. 1, application serviceslogically reside at the Application Service Layer (AS Layer) in the UserPremises Network, i.e., on the hardware components located in the userpremises, such as, by example, a gateway device 10. In contrast, suchapplication services traditionally were offered from network-sideservers on the Service Provider network side of the Network ServiceProvider Demarcation. In the exemplary architecture only a managementfunction for the application service layer remains on the serviceprovider side of the demarcation line, for example, in a servicemanagement center 50.

Gateway device 10 of FIG. 1 may provide applications and services to anaudio-video system in a user premises via an Application Client residingon digital media device 35. In particular, the programming thatimplements application services is logically positioned on the userpremises side of the Network Service Provider Demarcation. Theapplication service on the user premises side that enforcesauthorization, authentication, configuration, or use of the respectiveservice via an endpoint device (e.g., digital media device 35 andassociated audio-video system 530) is logically depicted in FIG. 1 asthe Application Service Enforcement (ASE) module in the AS Layer of theUser Premises Network. The ASE module may also communicate via the widearea network with the Application Service Management (ASM) logicresiding in service management center 50.

As discussed more below, the Applications Services Logic (ASL) and theASE functions shown in FIG. 1 are implemented on the User Premises sideas high-level server type logic within gateway device 10. Other elementsshown in FIG. 1 that may reside in gateway device 10 include the userpremises-side network function or NF (switch, router or bridge) and thelocal area network (LAN) termination for communication with the endpointdevices implementing the application client functions. Thus, withreference to FIG. 1, the first interface for enabling bi-directionalnetwork layer communications on the user's side of the premises with oneor more of the associated endpoint devices resides at the NetworkInterconnect Layer (LAN) Layer and provides the LAN Terminationreferenced therein. FIG. 1 also depicts the wide area network (WAN)termination providing connectivity to the wide area network(network-side NF—Internet or private wide area data network). One ormore of the associated endpoint devices may be digital media device 35(as illustrated in more detail in FIGS. 2 and 3) communicatively coupledto a television display or to audio-video system 530 having a televisiontype output. The second interface of gateway device 10 for enablingbi-directional directional network layer communications for theassociated endpoint devices via a wide area network resides at the NILayer and provides the WAN Termination referenced therein. The secondinterface of gateway device 10 also enables bi-directionalcommunications between it and the service management center via the WAN.

With reference to FIG. 1, the core of the logical capacities of servicemanagement center 50 resides on the Service Provider Network, and isdepicted as the Application Service Management (ASM) portion of theApplication Service Delivery Platform in the AS Layer. The ASM functionis implemented in service management center 50, which is external to theuser premises, and, perforce, on the network side of the demarcationline. The ASL and ASE functions maintain logical connectivity orinteraction with the ASM function in service management center 50,typically via communication through a wide area network. This logicalconnectivity is established through an always-on (or on an as needed,periodic basis), secure communication channel between the User PremisesAS Layer (ASL and ASE) in gateway device 10 and the Service Provider ASLayer (ASM) at service management center 50. Service management center50, and the communications of service management center 50 with one ormore of gateway devices (e.g., gateway device 10), provides aninfrastructure support and/or management of the application servicesoffered to associated endpoint devices and their users by the logicimplemented in the gateway device(s) 10. As further described herein,one or more of the associated endpoint devices may be a digital mediadevice (e.g., digital media device 35) communicatively coupled to atelevision display or to an audio-video system (e.g., audio-video system530) providing a television type output. Effectively, the ApplicationService Delivery Platform (ASD), considered in its entirety, extends allthe way to the User Premises and traverses the Network and NetworkService Provider Demarcation. The secure communications channel isestablished through the NF Layer and the NI layer.

The examples discussed herein also introduce a logical platformmanagement layer to the user premises-side, which allows for inter-layerallocation of local resources so as to provide applications and orservices to digital media device 35 residing within a user premises.This function guarantees access between the Application Service Logicfunction on the user premises network and the applications servicemanagement function in service management center 50 by assuring that thelocal user premises hardware (e.g., digital media device 50) andsoftware modules are functioning at a required state (CPU and memoryusage, bandwidth usage, QoS settings, etc.) in order for the ASL to havethe necessary resources to establish its required communications path tothe ASM.

The platform manager is also responsible for implementing that part ofthe managed application services to be performed by gateway device 10.In that regard, the platform manager secures and manages the overallhardware platform, given that in this scenario, the NF layer and the ASlayer reside on one hardware platform. This secure hardware platformprovides a robust and secure operating environment for the AS Layer. So,to establish a secure and robust hardware operating environment, theplatform manager must interface with all the layers above it and allowfor bi-directional management information flow among all of thefunctions. For example, if the Application Client residing on digitalmedia device 50 is a telephony application and the desired applicationis call processing, the application must first connect to the LANtermination interface (1). Then a connection must be established to theAS Layer through the NF layer (2). At this point the platform managerdetermines if there are sufficient resources available for this to takeplace on the routing and switching modules and if there is notsufficient resources on either the LAN Termination interface or the NFlayer functions, it would take the necessary corrective measure to freeup the required resources so that the application can execute properly(e.g. prioritize packets, throttle bandwidth, attempt to reduce noise onan RF (radio frequency) interface, or free up time slices on a TDMAinterface such as MoCA). Once that is done, the connection isestablished to the AS Layer (3), where the ASE and ASL, having beenupdated by the ASM in the network, respond instantaneously to theApplication Client of the digital media device, completing the servicerequest.

Application services represent functionalities, implemented in thehigher layer(s) of the protocol or logical stack above the networklayer(s) that may extend up to the top application layer (layer 7 of theOS model). An application service, for example, provides applicationserver communication with a client functionality of one or more endpointdevices, for the respective service, communicated on top of networklayer communications through the interfaces. In the examples, theservices are provided on a subscription service basis to users at thepremises, where the one or more endpoint devices may be digital mediadevice 35 communicatively coupled to a television display or toaudio-video system 530 having a television type output. As describedabove, one or more the application clients may be residing on digitalmedia device 35. Hence, the application service logic providesenforcement regarding authorization, authentication, configuration,and/or use of the respective service via the endpoint devices. Theapplication service includes service and feature functions, implementedand controlled by the application service logic. Management of theapplication service is based on communications with service managementcenter 50 via the wide area network.

The illustrated architecture of the gateway device 10—service managementcenter 50 network, along with digital media device 35 and associatedaudio-video system 530 within the user premises, enables other featuresand capabilities that have not previously been available to the user.For instance, peer-to-peer application communication between or amonggateways and/or digital media devices is possible without the need to gothrough, or utilize resources at, an external service management center.The peer to peer communication may be enabled using a presence andnetworking protocol, such as an instant messaging type protocol.Communications through service management center 50 are also possible.

Given the considerable functionality present in gateway device 10, andits ability to manage the various endpoint devices associated with it(e.g., one or more digital media devices 35 coupled to a televisiondisplay or to an audio-video system 530 having a television type outputas explained below), the user interface with gateway device 10 and/ordigital media device 35 can be presented and utilized on the home TV(e.g., television display, etc.). Additionally, information from otherendpoint devices, such as the PC, network sources (such as an RSS(Really Simple Syndication) service), may now be overlaid or insertedinto a display on the TV screen so that, for example, PC messages, orweather information, can be viewed on the TV screen, and thefunctionality of the PC (or other home-networked endpoint devices) canbe accessed from the TV screen. Gateway device 10 and its role in amedia and distribution system for a user premises having digital mediadevice 35 is discussed below in connection with FIGS. 2 and 3.

Media and Service Distribution System

FIG. 2 illustrates media and service distribution system 500, withgateway device 10, digital media device 35, media source 510, andtelevision display 32 having interfaces 540. FIG. 2 also illustrates analternative arrangement, where digital media device 35 iscommunicatively coupled to audio-video system 530 that includestelevision display 32 and interfaces 540. Accordingly, as describedthroughout, television display 32 may operate with digital media device35, or may operate as part of audio-video system 530 with digital mediadevice 35.

Digital media device 35, as described throughout, may be a set top box(e.g., set top box 35 a illustrated in FIG. 5) or digital media adaptor(e.g., digital media adaptor (DMA) 35 b, shown in FIG. 5). Digital mediadevice may also have a data communications link in the user premiseswith gateway device 10. In an exemplary embodiment, gateway device 10and digital media device 35 may be integrated into a single device, orgateway device 10 and digital media device 35 may be coupled togethervia a data communications link. One or more of the associated endpointdevices of media and service distribution system 500 may be digitalmedia device 35 communicatively coupled to television display 32 (e.g.,which may be separate from or included with audio-video system 530).Digital media device 35 may present a graphical user interface for atleast part of a display (e.g., an insert or overlay) on televisiondisplay 32 for enabling a user to selection applications, services,media, or any suitable combination thereof.

Gateway device 10 may communicate with digital media device 35 via awired or wireless communicative coupling serving as the datacommunication link within the user premises. The data communicationslink may be, for example, a user premises data communications network, aUSB (Universal Serial Bus) link, or any other suitable communicationslink. For example, gateway device 10 may utilize a Wi-Fi wirelessnetwork or an Ethernet wired network in order to communicate withdigital media device 35. In addition to being communicatively coupledwith digital media device 35, gateway device 10 may be communicativelycoupled via a wireless link or wired link to wide area network 99. Thewide area network 99 enables communications with the application servicemanagement center 50, which may, at least in part, provide and manageapplications provided to gateway device 10 and digital media device 35.Digital media device 35 may be communicatively coupled with gatewaydevice 10 via a wired Ethernet connection or other suitable wiredconnection. For example, the digital media device may communicate withgateway device 10 via Ethernet and a HTTPS connection to renderapplication services to, for example, television display 32.Alternatively, digital media device 35 and gateway device 10 may becommunicatively coupled via wireless communication.

As shown in FIG. 2, digital media device 35 may be communicativelycoupled with various digital storage devices 520, which may include, butare not limited to digital camera 522, Flash memory device 524, personalmedia player (PMP) device 526, etc. Digital media device 35 may have atleast one interface, such as a USB (Universal Serial Bus) interface, tocommunicatively connect devices such as cameras, portable media players,flash memory drives, or other storage based devices to digital mediadevice 35 directly.

Digital media device 35 may be configured to support a fixed media modein order to be recognized, since fixed media mode allows the device'scontents to be viewed as files. Exemplary devices (e.g., devices 522,524, 526, etc.) may be represented as a mapped drive on gateway device10 and available for access by a personal computer (e.g., computer 30 aor 30 b shown in FIG. 5) or other device and digital media device 35 fordisplaying pictures, playing music, rendering movies, or presentingother audio and/or video media. Digital media device 35 may beconfigured to automatically detect the connection of a USB device orother similar device, and generate a notification message for display ontelevision 32, which may be part of audio-video system 530. Thenotification may contain the name, type of device, and/or other relatedinformation. The size and position of the notification displayed on thetelevision may be configurable. An icon or other graphical indicationmay be displayed on the television display in order to identify theconnected device. Preferably, the icon or other graphical indication maybe present on the television display during the period that the deviceis connected with digital media device 35.

Digital media device 35 may be communicatively coupled with a displaydevice such as television display 32 having one or more input/outputinterfaces 540. Alternatively, in the case of audio-video system 530,digital media device may be communicatively coupled with television 32of audio-video system 530 via interfaces 540, and/or may also becommunicatively coupled to audio-video system via interfaces 545.Interfaces 540 and 545 may include component video, S-video, HDMI (highdefinition multimedia interface), composite video, analog audio, digitalaudio, or any other suitable interface.

Digital media device 35, television display 32, and/or audio-videosystem 530 may be controlled by remote 550 via a wired or wirelesscommunication system (e.g., using infrared (IR) signals, radio frequency(RF) signals, etc.). As illustrated in FIG. 9 and described below,digital media device 35 may have remote control interface 640 to supportcommunications between remote 550 and digital media device 35. Digitalmedia device 35 may be configured to support the processing of signalsfrom remote 550, and digital media device 35 may also configure remote550 to control the functions of other devices, e.g., television 32,audio-video system 530, etc. Remote control 550 may have a number ofbuttons for interacting with the graphical user interface (e.g., asillustrated in FIGS. 8A-10D and 12A-131) that may be, for example,presented on television 32. Remote control 550 may have various functionkeys or buttons that include, but are not limited to directional buttons(e.g., up, down, left, right, etc.), functional buttons (e.g., stop,play, pause, next, back, fast-forward, rewind, skip, page up, page down,select, zoom in, zoom out, etc.), a numeric keypad, or any othersuitable set of buttons for interactive user input. Remote control 550may be configured to support a library of codes or commands forcontrolling other devices such as television 32 and media source 510(e.g., DVD players, VCRs, DVRs, etc.). Those skilled in the art willrecognize that other user input devices may be used, in place of or inaddition to the remote control 550.

As shown in FIG. 2, digital media device 35 may also be communicativelycoupled with media source 510. Although one media source 510 is shownfor simplicity, digital media device 35 may be communicatively coupledto multiple media sources. Media source 510 may be an in-premises analogor digital cable television distribution or the like, a video cassetterecorder (VCR), a video game console, a digital video recorder (DVR), adigital versatile disc (DVD) device, an analog or digital broadcasttelevision signal, an analog or digital cable headend, a satellitetelevision signal source, an analog or digital radio broadcast, or anInternet source providing audio, video, or both audio and video, anysuitable combination thereof, or any other media source.

Digital media device 35 may support a plurality of different audio andvideo input and output interfaces (as further discussed below inconnection with FIG. 3). For example, digital media device 35 may havevideo interfaces HDMI, component video, composite video, S-video, or anyother suitable interfaces. Digital media device 35 may also have aninterface to support at least one tuner, at least one data port, anycombination thereof, or any other suitable interfaces. Digital mediadevice 35 may have a digital audio interface (e.g., Sony/Philips DigitalInterface Format (S/PDIF)) or an analog audio interface, or any othersuitable audio interface. The audio interfaces may be paired orintegrated with the analog or digital video interfaces. The videointerface may, for example, support a plurality of standard definitionvideo streams, a plurality of high definition video streams, or acombination of standard and high definition video streams. In addition,the wired network interface and/or the wireless network interface ofdigital media device 35 (as discussed below in connection with FIG. 3),may support digital audio streams, digital video streams, or audio andvideo data streams, or be configured to receive digital audio and/orvideo data files.

Digital media device 35 may support picture-in-picture (PIP)functionality, and may further support the ability for a user toconfigure the size and location of the PIP window within a display(e.g., a display presented on television display 32). Digital mediadevice 35 may support picture-outside-picture (POP) where a plurality ofwindows of video may be displayed in an arrangement relative to a mainvideo display window. For example, the POP windows may be displayedaround the edge of the main video display window. Digital media device35 may be configured to adjust the size and position of the main POPwindow, as well as configure the size, position, and number of secondarywindows for POP. In addition, digital media device 35 may support thedisplay of two windows of video side-by-side. Digital media device 35may also support picture-in-graphic (PIG), where a video image maydisplayed in a window within a separate graphical image. Digital mediadevice 35 may be configured to toggle video displays between the mainwindow and secondary windows for PIP, POP, PIG, and side-by-side.Digital media device 35 may be configured to receive a signal (e.g.,from remote control 550) to change the focus between the main windows,secondary windows, side windows, or graphical area, or any suitablecombination thereof. Digital media device 35 may be configured toreceive a selection (e.g., from remote control 550) as to an audiosignal or stream to be played by a television or audio/video system forPIP, POP, PIG, side-by-side, or composite video images (e.g., overlaysor insert displays), or any suitable combination thereof.

Audio or video files stored on gateway device 10, audio or video signalsreceived via wide area network 99, or audio or video received via mediasource 510 may be passed through to at least one audio or videointerface of digital media device 35 and/or may be received via anetwork interface (e.g, wireless network interface 650 or wired networkinterface 660 illustrated in FIG. 3). A plurality of video streams(e.g., a plurality of digital video streams, a plurality of analog videostreams, or a plurality of analog and digital video streams) may beintegrated to form a composite signal, which may be used to display acomposite display on television display 32, or present a compositesignal for presentation on audio-video system 530. This plurality ofvideo streams that may be combined to form the composite signal may beintegrated with at least one analog audio signal or digital audiosignal, where the audio signal may provide audio substantiallycontemporaneously with the composite image. Alternatively, a pluralityof audio signals may form a composite signal and may be played onaudio-video system 530.

These capabilities of the digital media device enable presentation of aninteractive graphical user interface for application services offeredthrough the gateway device 10, e.g. from the wide area network, totelevision display 32. For example, the GUI may provide audio and/orvideo output via a television presentation and allow user input via theremote control 550. The GUI allows the user to select and interact withgateway enabled services. Such services may include, but are not limitedto: viewing movies; viewing photos; playing music; controlling homedevices of an in-home network; playing video games; controlling securityfeatures such as parental control; file backup; or any other suitablefunctions. The GUI also offers various notification and responsefunctions, for example, receiving notifications of voicemail, incomingcalls, or alert or update messages from devices connected to an in-homenetwork or via wide area network, or weather updates, or other suitablenotifications, alarms, or messages.

DRM and Non-DRM Content

Digital media device 35 may be configured to acquire, store, and executea device application for playing protected content (e.g., audio, music,video, etc.). The device application may be utilized to decrypt orunlock protected content for playback as authorized by the contentprovider's license and terms of use. The application may be representedby the content providers (CP) license manager and may be stored ondigital media device 35. Each content provider shall have their ownlicense manager stored on digital media device 35.

Digital media device 35 may be configured to access content stored on oravailable from gateway device 10. The content may include DRM (DigitalRights Management) and non-DRM content. If the accessed content has DRM,then digital media device 35 may acquire the license related to the DRMcontent and then render the content to the user subject to the uselimitations set by the content and/or service provider rules of the DRMlicense. For example, digital media device 35 may support rendering ofthe WMDRM (Windows Media Digital Rights Management) protected content.The DRM and non-DRM content may include, but is not limited to photos,music, audio, video, any other suitable content, or any combinationthereof.

Content to be presented (e.g., audio, music, pictures, video, etc.) maybe controlled by media control functionalities such as pause, play,stop, delete, fast forward, rewind, scan (jump forwards or backwards byx number of seconds in playback), etc. These media controlfunctionalities may be graphically represented on a playbar that isdisplayed on television display 32 or other display (e.g., computerdisplay, etc.). The playbar may be presented as an insert into oroverlay onto the display of the television display 32.

Display Inserts and Overlays

In forming a composite signal, digital media device may use at least onesignal from media source 510 to form a primary image and may useapplication service information from gateway device 10 to form asecondary image, wherein the television display is configured to displaythe secondary image overlaid on or inserted into the primary image toform the composite image. For example, FIG. 7A illustrates a videodisplay of TV program images 800 from media source 510 as a primaryimage, and weather information 802 obtained via the gateway device 10overlaid onto video display images 800 as the secondary image.Alternatively, application service information (e.g., obtained viagateway device 10) of the composite signal may form a primary image, andat least one media signal (e.g., via media source 510) form a secondaryimage, wherein the television display (e.g., television display 32) isconfigured to display the secondary image overlaid on or inserted intothe primary image to form the composite image. Digital media device 35may also form a composite signal from at least one an audio signal fromthe application service information from gateway device 10 or from mediasource 510, where the audio signal provides audio substantiallycontemporaneously with an image or composite image on television display32. The audio information regarding the application service from thegateway device 10 may be inserted as a segment in place of regularprogram audio or mixed with the regular program audio signal. Digitalmedia device 35 may also be configured to form an audio signal as acomposite of audio of a media signal from media source 510 and audioinformation of the application service information from gateway device10 for presentation on audio-video system 530, e.g., with the videoconsisting of one or more images derived from the application serviceinformation and audio based on a composite of the program informationand the application service information.

Messaging

The application service information received by digital media device 35from gateway device 10 may include notifications of status with regardto one or more application services managed by gateway device 10.Digital media device 35 may be configured to receive the notificationsof status from gateway device 10 and transmit a message related to theselection signal to the gateway device 10 using a presence andnetworking protocol. The presence and networking protocol may be aninstant message type protocol.

Playlist

Digital media device 35 may also be configured to present a playlist(e.g., a playlist of music, audio, pictures, video, etc.) as an insertor overlay on television display 32. The playlist may be managed by auser by utilizing the overlaid or inserted interface For example, a usermay utilize the interface to play from a playlist, create a playlist,add items to the playlist, remove items from the playlist, shuffle theplaylist, or share playlist with comments, or any other suitableplaylist function.

Photos

Digital media device 35 may be configured to display photos on atelevision display or other display. The size and position of each photorendered may be configurable. Digital media device 35 may be configuredto display the photos from digital storage on digital media device 35,USB devices (e.g., devices 522, 524, or 526, etc.), devices connected towide area network 99, or devices connected to the in-home network (e.g.,network 60 shown in FIG. 5). The photos may be arranged in a slideshow,and digital media device 35 may be configured to associate an audioplaylist with a slideshow. Digital media device 35 may be configured topush a slideshow (with or without accompanying audio) to audio-videosystem 530, television display 32, or to one or more endpoint deviceswithin the premises or to devices communicatively coupled to the widearea network. For example, such devices may be registered on a “buddylist.”

Caller ID/Messaging

Digital media device 35 may be configured to support the display ofcaller identification notification in an overlay or insert on thedisplay on television display 32. For example, the notification maydisplay graphics or images associated with the calling party number. Anexemplary composite image having video image 810 with overlay 812 isshown in FIG. 7B. As shown, incoming caller phone number information 814and caller graphic 816 overlaid on video display 810. Digital mediadevice 35 forms a composite signal from caller information and graphicsalong with a media signal from media source 510. The composite signalforms the composite image, which is presented on television display 32.

In addition, a message waiting indicator may be displayed over thetelevision when a new voicemail message is received for the currentuser. Digital media device 35 may be configured to sort the list ofvoicemail messages by the date the voicemail was left or the callingparty number. The voicemail screen may identify which voicemail messagesare new. Messages may be considered new if they were received after thelast time the user accessed the user's voicemail box. The messagewaiting indicator, as described above, may be removed, e.g., byacknowledging the presence of the indicator via a selection using theremote control or my any other suitable means, or once the user accessesat least one new message.

Digital media device 35 may be configured to play voicemail messagesover the television display 32 or audio-video system 530. Digital mediadevice 35 may insert or overlay graphic controls on television display32 to playback the voicemail, stop playback of voicemail, pause thevoicemail playback, fast forward through at least a portion of thevoicemail message, rewind at least a portion the voicemail message, moveto the next voicemail message, or move to the previous voicemailmessage, delete the voicemail message, or any other suitable function.

Digital media device 35 may be configured to display a list of missed,received, or dialed telephone calls. The displayed list may be anoverlay or insert on the television display or other display. The depthof the call log list may be configurable by a user. Digital media device35 may be configured so that each number listed in a call log may beselected for dialing, or may be added to a user's contact list (i.e.,address book).

Digital Media Device

FIG. 3 is a functional block diagram of an exemplary digital mediadevice 35 shown in FIG. 2. The digital media device 35 may serve as aset-top box or as a digital media adapter for a television or otheraudio-video system. As shown in FIG. 3, the digital media device mayhave processor 600, which may be a central processing unit, applicationspecific integrated circuit (ASIC), programmable logic device (PLD), anintegrated circuit, or any other suitable processing device. Processor600 may be communicatively coupled to memory 602 and digital storagedevice 604. Memory 602 may be any suitable Random Access Memory (RAM),and digital storage 604 may be any suitable non-volatile storage device,such as a hard disk drive, semiconductor memory, memory card, an oroptical drive. Processor 600 may be configured to service a plurality ofaudio interfaces 610 with inputs and outputs, as well as a plurality ofvideo interfaces 620 with inputs and outputs. The inputs and outputs ofaudio interlaces 610 may be stereo pairs (left and right audiochannels). The operation of processor 600, audio interfaces 610, videointerfaces 620, and additional interlaces of digital media device 35 aredescribed in further detail below.

Digital media device 35 may also have at least one wireless networkinterlace 650 (e.g., a Wi-Fi wireless network interface) and at leastone wired network interface 660 (e.g., an Ethernet wired networkinterface). Digital media device 35 may communicate, for example withgateway device 10 via wireless network interface 650 or wired networkinterface 660. The wired network interface 660 and/or the wirelessnetwork 650 interlace of digital media device 35 may support digitalaudio streams, digital video streams, or audio and video data streams,or be configured to receive digital audio and/or video data files.

As illustrated in FIG. 3, digital media device 35 may also have homeautomation interface 670 communicatively coupled to processor 600. Homeautomation interface 670 may be, for example, an X10, Z-Wave, or ZigBeeinterface, or any other suitable interface. Home automation interface670 may enable the functionality of user interfaces (UI), access homeautomation, and other appliances.

Digital media device 35 may also have at least one peripheral interface680, such as a USB interface, in order to enable communications betweenprocessor 600 of digital media device 35 and mass storage devices (e.g.,devices 522, 524, and 526 illustrated in FIG. 2).

At least one audio interface 610 may be, for example, communicativelycoupled to one or more devices that may comprise a media source (e.g.,media source 510 shown in FIG. 2) that provides, at least in part, anaudio type signal. Audio interface 610 may also be communicativelycoupled to interfaces 540 of television display 32 and/or to interfaces545 of audio-video system 530 in order to present audio type mediacontent to audio-video system 530 or television display 32. The audiotype media content may be provided by, for example, media source 510,gateway device 10, flash memory device 524, PMP device 526, or any othersuitable source. In addition, audio type signals may be provided fromdigital storage device 604, tuner 630, wireless network interface 650,wired network interface 660, home automation interface 670, orperipheral interface 680 via processor 600, which may provide audio typesignals to audio interface 610 for output for an audio typepresentation. Processor 600 may also combine two or more signalsreceived from interfaces 610, 650, 660, 670, 680, or from tuner 630 ordigital storage device 604 to provide a composite audio signal to atleast one audio interface 610 for output for an audio type presentationor as part of an audio-video presentation.

At least one video interface 620 may be communicatively coupled to, forexample, media source 510. Media source 510 may provide, at least inpart, video type signals to video interface 620, or alternatively, mayprovide digital audio and/or video signals via a networkingcommunications protocol to wireless network interface 650 or wirednetwork interface 660. In addition, at least one video interface 620 maybe communicatively coupled to interface 545 of audio-video system 530and/or to interface 540 of television 32 so that video type content maybe delivered from digital media device 35 to audio-video system 530and/or television 32 for at least some video type presentation.Additionally, video type signals may be provided from gateway device 10(and received, e.g., by wireless networking interface 650 or wirednetworking interface 660), digital camera 522, flash memory device 524,PMP device 526, or any other suitable device and output to audio-videosystem 530 and/or to television display 32 for at least some video typepresentation. In addition, video type signals may be provided fromdigital storage device 604, tuner 630, wireless network interface 650,wired network interface 660, home automation interface 670, orperipheral interface 680 via processor 600, which may provide video typesignals to at least one video interface 620 for output for a video typepresentation. Processor 600 may also combine two or more signalsreceived from interfaces 620, 650, 660, 670, 680, or from tuner 630 ordigital storage device 604 to provide a composite audio signal to atleast one video interface 620 for output for a video type presentationor as part of an audio-video presentation.

At least one audio interface 610, at least one video interface 620, or acombination thereof may be used to output an audio type presentation,video type presentation, or audio-video type presentation signalgenerated by processor 600, where the signal may include an insert oroverlay audio and/or video signal for presentation on audio-video system530 and/or television display 32. The insert or overlay video signal mayalso include a graphical user interface (e.g., as illustrated in FIGS.8A-10D and FIGS. 12A-131). At least a portion of the programming that isexecuted by processor 600 to enable the graphical user interface may beat least in part on digital storage device 604.

Digital media device 35 may include at least one tuner 630 for receivingaudio signals or video signals from a media source (e.g., media source510 illustrated in FIG. 8). Tuner 630 may be communicatively coupled toprocessor 600. As described above, at least a portion of the signalreceived by tuner 630 may be output via audio interface 610, videointerface 620, or a combination thereof. A signal received by tuner 630may be combined with at least one other signal from at least oneinterface or device by processor 600 in order to form a composite signalwhich may include audio type content, video type content, or audio andvideo content.

In forming the composite signal, processor 600 may be configured tosynchronize the audio signals and/or video signals to form asynchronized composite signal. For example, processor 600 may utilizememory 602 or digital storage device 604 to buffer the audio signalsand/or video signals, and may retrieve at least a portion of the storedaudio and/or video signals from the buffer in memory 602 or digitalstorage device 604 to edit (e.g., remove existing audio signalsassociated with a video signal) and synchronize the audio and/or videosignals in forming the composite signal. Buffering the audio and/orvideo signals may be desirable for filtration of the audio and/or videosignals, as well as to enable the processor to address timing delaysbetween the received signals that are to be used to form the compositesignal. For example, audio information associated with a received videosignal (e.g., a television signal containing video and audioinformation) may be removed from the video signal, and processor 600 mayretrieve the separate buffered audio signal to synchronize with thecontent of the filtered video signal to form a composite signal. Tofurther illustrate the above example, the video signal may be a footballgame that contains audio commentary from announcers. This signal may bebuffered in memory 602 or digital storage device 604, and the audiocontent may be filtered out by processor 600. A separate audio signalthat may be audio commentary of the same football game by differentannouncers may be buffered by processor 600 into memory 602 or digitalstorage device 604. Processor 600 may synchronize the filtered videosignal and the buffered audio signal to form a composite signal, suchthat the content of the audio signal is relevant to the content of thevideo signal. The resulting composite signal may present synchronizedaudio and video type content for presentation to a user.

Digital media device 35 may digitally record or store audio, video,images, any combination thereof, or any other suitable media receivedfrom audio interface 610, video interface 620, tuner 630, wirelessnetwork interface 650, wired network interface 660, and/or peripheralinterface 680 for or playback in memory 602, on digital storage device604, or on digital storage device 520 communicatively connected todigital media device 35. For example, digital storage device 604 mayrecord incoming television signals from tuner 630. Accordingly, memory602 or digital storage device 604 may serve as a buffer for audio andvideo data, and a user may “pause” the display of a television signal(e.g., using a remote control), and memory 602 or digital storage device604 may continue to record the incoming television signal from tuner 630such that a user may view the recorded television signals that are beingbuffered after the user de-selects the “pause” option. Gateway device 10(as shown in FIGS. 2 and 5) may also digitally record or store audio,video, images, or any combination thereof on a non-volatile harddrive/disk magnetic and/or optical disk memory storage. For example,gateway device 10 may store audio, video, images, or other audio-visualpresentations initially recorded by digital media device 35 in memory602, digital storage device 604, or on digital storage device 520 whichis communicatively coupled to digital media device 35. Recordings frommemory 602, digital storage device 604, or digital storage device 520may be transferred (e.g., in response to instructions received fromservice management center 50) to gateway device 10 so as to increase theavailable digital storage available in the user premises. Recordedaudio, video, images, or audio-visual presentations that have beentransferred to gateway device 10 may be retrieved as requested by a user(e.g., digital media device 35 may receive a selection from a user forrecorded audio, video, or audio-visual presentation, and digital mediadevice may retrieve the selection from the digital storage of gatewaydevice 10 for presentation on television display 32 or audio-visualsystem 530).

Digital media device 35 may also have remote control interface 640,which may be communicatively coupled to processor 600. Remote controlinterface 640 may be configured to receive wireless signals (e.g.,infrared signals, radio frequency signals, etc.) from remote 550illustrated in FIG. 3 and described above. Remote 550 may be used toselect applications or media sources presented to the user on televisiondisplay 32 and/or audio-video system 530.

The description provided below further details providing and managingapplication services to a gateway device and to a digital media device.

Managed Application Services Delivery Platform

FIG. 4 depicts, at the Physical/Network layer shown therein, an exampleof user premises hardware components required for delivering dataservices (i.e. Internet connectivity) along with a separate,non-integrated managed hardware used in delivering a set of managedapplication services (e.g. VOD, IM, home automation, IP telephony). Aswill become apparent from the further discussion, some or all of theelements will form a gateway device at the network edge, forcommunication with endpoint devices including a digital media device.

The Network Service Provider Wide Area Network Termination Apparatus(NSP-TA) allows for a typical termination of Wide Area Network Services,such as DSL, Cable, Fiber, etc, by a network services provider. TheNSP-TA provides the WAN Termination in the NI layer (FIG. 1). The NSP-TAmay be an existing user-premises device, provided by the carriersupplying network services to the premises, FIG. 4 also depicts theNetwork Service Provider Demarcation at the hardware level.

If configured as a standalone device, the NSP-TA device is required tohave its own CPU, Memory, physical interfaces and logic control. Inorder for Network Service Providers to deliver managed services, theytypically require a management element controlled by the CPU on theNSP-TA. To depict these logical elements residing on the hardwarecomponents, FIG. 2 includes an Application/Services Layer above thehardware layer. This layer corresponds to the AS Layer of FIG. 1, butwithout reference to any logical elements residing at the networkservices provider. The management element, represented by the NetworkService Provider Managed Application, allows the network serviceprovider to determine the status of the network hardware device andinterfaces as well as maintain a certain degree of security enforcementat the customer premises. As noted, the network service functionality isat the NI and NF Layers and generally does not extend to the AS Layer(s)beyond basic authentication authorization and state management. As withthe hardware components, the logical elements also have a NetworkService Provider Demarcation as shown in FIG. 4. On the WAN side,depicted as the Network Service Provider Managed Applications side, ofthe Network Service Provider Demarcation, resides the applications thatare managed, and under the exclusive control, of the network serviceprovider (the Network Service Provider Logic). The User Interface toManaged Applications is present on the LAN side of the Network ServiceProvider Demarcation within the Application/Services Layer. Within thisinterface resides programming and logic available to users other thanthe network service provider referred to as the Network User ControlledLogic. The Network User Controlled Logic, which is depicted at theApplication/Services Layer in FIG. 4, provides a user interface to theNetwork Service Provider Logic and, to the extent permitted by theNetwork Service Provider Logic, interaction with or communicationbetween the user and network service provider through the Network UserControlled Logic and the Network Service Provider Logic, and to theNSP-TA hardware components. The Network User Controlled Logic allows forthe User of the hardware to make certain, minimal programming changesrelevant to their preferences (e.g., user name and password changes,local IP addresses changes, local interface selection). All user devicestypically can only communicate with the NSP-TA through one or more ofthe User Premises Network Interfaces. The user can modify the NetworkUser Controlled Logic through the User Premises Network Interface. TheNetwork Service Provider Demarcation is typically within the NSP-TA,logically dividing the Network Service Provider Interface and the UserPremises Network Interface modules. The network service provider doesnot have any in depth visibility or significant responsibility beyondthe Network Service Provider Demarcation.

The User Network and Application Delivery Apparatus (UNA-DA), shown onthe right hand side of FIG. 4, is a separate managed gateway device thata managed service provider (which may be different than the networkservice provider) would control in delivering a set of applicationservices to the user premises (e.g., to a digital media device). Thisdevice is required to have its own dedicated CPU, memory, logic control,as well as its own dedicated set of interfaces. The UNA-DA includes oneor more Network Interfaces providing connectivity to the NSP-TA as wellas to user premises endpoint devices (e.g., digital media device 35 thatis coupled to audio-video system 530 and/or television display 32 inFIG. 2, etc.). The interfaces provide the LAN Termination functionalityat the NI Layer (FIG. 1). One skilled in the art will readily recognize,however, that the physical connection that connects the UNA-DA to theNSP-TA also provides connectivity for the UNA-DA to the public (WANside) network, and is the means by which the UNA-DA accesses the publicnetwork. The end point devices connected to the LAN Interface are on theprivate (LAN) side of that interface. The UNA-DA also includes a switch,router or bridge for the NF Layer.

Programming elements of the UNA-DA are depicted at theApplication/Services Layer of the UNA-DA. Certain logical elements,depicted as the Application Service Provider Managed Applications andPlatform in FIG. 4, on which resides, inter alfa, the programmingcorresponding to the ASL and ASE of FIG. 1, are managed by the managedapplication service provider's network control center, e.g., by the ASMof service management center 50 through a wide area network (WAN) bymeans of a control channel to the Application Service Provider ManagedApplications and Platform. The Application Service Provider ManagedApplications and Platform includes a platform management logic modulethat, with other programming in the Platform and the ASM, allows themanaged application service provider to control the hardware elements ofthe UNA-DA in addition to any other relevant application services logicor hardware that may reside on the user premises. For example, thisprogramming enables managed application service provider to control andmanage the hardware elements on the UNA-DA to ensure proper use andallocation of the UNA-DA's processing, memory, storage, and bandwidth,to monitor local hardware security and generate needed alarms orprotection sequences, and to prioritize applications based on a set ofestablished policies. The user would have control over specificparameters of the UNA-DA through the User Interface and Platform toManaged Applications (User Controlled Logic) shown in FIG. 4. Theseparameters allow the user to control the local behavior of theinterfaces and to configure the specific applications to accommodate theuser network as configured by the user and to implement the userpreferences for those applications.

To identify the separation of, and distinguish between, the programmingand hardware components subject to control by the managed serviceprovider and those subject to control by the user premises, FIG. 4identifies a dividing line across the logical elements of the UNA-DA,and a corresponding dividing line across hardware components, referredto as the Applications Service Provider Demarcation. The ApplicationsService Provider Demarcation is flexible in that it may extend logicallythrough the Application Services Interface (and, in a hardware context,through the Network Interlace) to other devices that are under thelogical control of the Application Services Provider ManagedApplications and Platform, given that “services” are not restricted to aspecific hardware boundary.

There is no hard requirement for cross management between the LINDA-DAand the NSP-TA. Under this first scenario the user is responsible formaking the configuration changes in the specific user controlled logicmodules in order to get the two devices to communicate with each other.Optionally the two sub-systems can be combined together, eitherphysically in one hardware device, or logically as two separate hardwaredevices, but having one user managed interface.

The two hardware regimes described above (NSP-TA and the UNA-DA) may becombined into one managed hardware platform and, thereby, replace theneed for the user to have access to the User Premises Network Interfacewith the logic residing in the Platform Management logic module of theApplication Service Provider Managed Applications and Platform. Thiswould in effect replace the “user” access with a managed “machine”access, for aspects of the NSP-TA, as well as aspects of the applicationservices offered through the UNA-DA. Thus, the combination creates anintegral gateway device providing both network service and applicationservices, under centralized management. Although integrated, networkinterconnect functions of the NSP-TA may still be managed by the networkservice provider, as in the example of FIG. 4. Those skilled in the artwill readily see additional combinations and configurations for thehardware comprising the NSP-TA and the UNA-DA. For example, in a furtherembodiment, all the hardware dedicated to the Network Service ProviderInterface may reside and be integral with the hardware comprising theUNA-DA. Thus, the hardware for the WAN interface may reside on theUNA-DA.

It may be helpful now to consider more detailed examples of the gatewaydevice-service management center network.

Gateway Device and Service Management Center Elements—Overview

Those skilled in the art will recognize that functions of the servicemanagement center, which reside in the Application Service Managementnode on the Service Provider Network, as depicted in FIG. 1, may beimplemented in a variety of different ways, on one or more computerhardware platforms connected to the gateway devices via a wide areanetwork. FIG. 5 depicts an example wherein the implementation is onInternet or other wide area IP network 99. The example uses adistributed processing approach, in which the elements/platformsimplementing the service management center are interconnected forcommunication and for wide area communication, and in this way, thoseelements form a network 50 for implementing the service managementcenter.

As shown in FIG. 5, the service management center network, through thelogical capabilities earlier depicted in FIG. 1 as the ASM module of theASD Platform at the AS Layer, manages application services for a numberof gateway devices 10, 10.sub.1 . . . 10.sub.n located at various users'premises. These application services, shown as ASL and ASE in FIG. 1,implement their functionality within the Application Services Layer(FIG. 1), through programming that resides, at least in part, within theApplication Service Provider Managed Applications and Platform of theUNA-DA (FIG. 4). As shown in FIG. 5, secure connectivity to the servicemanagement center network 50 is provided, in one embodiment, via a WANTermination interface, such as Ethernet WAN 53 over a broadbandconnection via the public Internet 99, or, for example, via a wirelessEvDO (Evolution Data Optimized) Internet data interface embodied as aPCMCIA (personal computer memory) wireless card 56. When the WANTermination interface 53 is used, for example, it may provideconnectivity to a broadband modem serving as the NSP-TA of FIG. 4,either as a separate unit or on a board included within the gatewaydevice 10. If the wireless WAN interface is used, there may be nophysical NSP-TA device, and the logic of the gateway device wouldimplement functions of the NSP-TA as well.

As will be described in greater detail herein below, the servicemanagement center 50 generally provides a communications and processinginfrastructure for supporting the variety of application services andrelated communications residing at the gateway devices 10, 10.sub.1 . .. 10.sub.n. In an exemplary embodiment, this infrastructure may beconfigured to provide a secure environment and may be IP-based.Preferably, this support architecture is designed for high availability,redundancy, and cost-effective scaling.

The secure platform for building and providing multiple applicationservices for digital endpoints associated with a gateway device requirescommunication connectivity between the gateway device 10 and each of auser's devices (referred interchangeably herein as “endpoint devices” or“digital endpoint devices” throughout, and where one or more of theendpoint devices may be a digital media device communicatively coupledto a television display or to an audio-video system having a televisiondisplay type output). Some associated endpoint devices may communicatewith the gateway device via a public network, e.g., when a user of theendpoint device roams outside the user premises. In most examples, thedigital media device will be within the premises, and the communicationsbetween the gateway device and the digital media device will utilizelocal in-premises data communication connectivity. This connectivity maybe provided by implementation of one or more USB ports (interfaces) 13,a wired Local Area Network connection such as provided by an Ethernetlocal area network (LAN) interface 16, or, a wireless network interfacevia a WiFi LAN access point 62 provided, for example, in accordance withthe I.E.E.E. 802.11b/g/n wireless or wireless network communicationsstandard. These physical interfaces provide the required networkinterconnectivity for the endpoint devices to connect to the multipleapplication services. Although not shown in FIG. 5, this connectivitybetween digital endpoint devices and the gateway device may beaccomplished by other means, including; by way of example, through of avirtual private area network connection accessed through a WANinterface.

That is, the gateway device 10 interfaces with digital endpoint devicesincluding, but not limited to: a home automation networking device 20(e.g. X10, Z-Wave or ZigBee) for wired or wireless home networkautomation and control of networked home devices such as a switchcontroller 22, sensor devices 23, automatically controlled window blinds24, a controlled lighting or lamp unit 25 etc, individual or wired orwireless network of personal computing (PC) and laptop/mobile devices 30a, . . . , 30 c that serve as file sources, control points and hosts forvarious other client endpoints, one or more television display devices32 including associated digital media devices 35, set top boxes (STB) 35a, or digital media adapters (DMA) 35 b, one or more VoIP phone devices(e.g. SIP phones) 40, or other devices (not shown) that convert IPinterfaces to PSTN FXO and FXS interfaces.

As noted earlier in connection with FIG. 2, the gateway device 10 mayprovide an interface to a digital media device, such as digital mediaadaptor (DMA) 35 b and audio-video system 530 or television (TV) 32,which enables bidirectional wireline or wireless communication. Thisinterface supports several functions for multiple services including,but not limited to: media (e.g., video and music) by enabling thetransfer of media (e.g., video and music) to the TV; voice services, byproviding for Called Line ID and for voice mail control; and provideHome Automation Services including status and control of networked homeautomation devices. The DMA element 35 b converts audio and/or video toa format suitable for an audio type presentation, a video typepresentation, or a combination of audio and video type presentation on atelevision display or audio-video system. In addition, the Digital MediaAdapter 35 b may be capable of receiving context-sensitive commands froma remote control device (shown in FIG. 2) and forwarding those commandsto the gateway device 10. This enables the use of menus on the TV 32 forcontrolling application services and various features functions thereof,as offered by the gateway device 10. For example, the digital mediaadaptor 35 b and television 32 combination is able to provide thefollowing features including, but not limited to: display of media;media control functions, when enabled (FF, REW, STOP, PAUSE, etc);display of Calling Line Identification (CUD); control of voicemail;picture viewing; control of home automation; and user functions for thegateway device 10.

A Set Top Box 35 a, as shown in FIG. 5, may handle media formatconversion (for example NTSC to ATSC television RF signals), digitaldecryption and other DRM (digital rights management) functions, andVideo On Demand Purchases, etc. As described above in connection withFIG. 2, Set Top Box 35 a may also be configured to operate as a digitalmedia device (e.g., digital media device 35 as shown in FIGS. 2, 3, and5 and as described above in connection with FIGS. 2 and 4). The Set TopBox/TV combination may thus enable, by way of example: Media formatconversion (for example NTSC to ATSC); decryption; other DRM functions(such as expiry of leases), prohibition of copying to digital outputs,function restriction, etc.; Video On Demand Purchases; and media controlfunctions (e.g., FF, REW, STOP, PAUSE, etc.). Alternatively, Set Top Box35 a may serve as a media source (e.g., media source 510 shown in FIG.2) communicatively coupled to digital media device, which may provideaudio and/or video type presentations to digital media device 35 andaudio-video system 530 or television display 32.

Whether provided by the DMA interface 35 b and the TV 32 (or audio-videosystem 530 shown in FIG. 2), by the set-top-box 35 a and the TV 32, orby digital media device 35 and TV 32, the communications to and from theTV provide a user interface for interaction with the gateway device 10.The programming of the gateway device and/or the digital media devicesupports, among other things, a graphical user interface (GUI) via theTV, sometimes referred to as the “ten foot” interface.

With respect to PCs interfacing with the gateway device 10, PCs mayserve as, among other things, file sources, control points and hosts forvarious software clients. Thus, the PC programming may work inconjunction with the ASL and ASE programming of the gateway device.Together, the PC programming and the ASL and ASE programming provide amore comprehensive and robust user experience. The gateway device 10 mayfurther provide a bidirectional wireline or wireless interface 35 c to aPC device 306 for supporting the transfer of media (e.g., video andmusic) to the computer for storage and viewing; for supporting voiceservices, e.g., by providing for calls from SIP (session initiationprotocol) soft clients; for file sharing, file back-up and home storageand home automation control functions. The access point 62 offerswireless data communications with a PC 30 c. The gateway deviceinterface through any PC may provide for the bidirectional moving offiles, and status and control for the endpoint devices, including forexample, status and control of networked home automation devices. Inaddition, using the PC interface, users may, for example, share files onthe gateway devices, back-up or transfer files to the gateway devices orother storage; access personal page for notifications, RSS, sharedphotos, voicemail, etc. In addition to the IM (instant messaging) andSIP capabilities of the gateway device, as described more below, PCs mayalso serve as a host for IM and SIP soft phone clients and other clientdevices. The client-server interaction of the PC with the applicationservice logic of the gateway device 10 offers an alternative GUI for atleast some of the services. The PC based GUI is sometimes referred to asthe “two-foot” interface.

Although not shown in FIG. 5, other digital endpoint devices for whichconnectivity may be established with the gateway device 10 include, butare not limited to: personal music or media players (e.g., device 526illustrated in FIG. 2), hi-fi audio equipment with media streamingcapability (e.g., audio-video system 530 illustrated in FIG. 2), gamestations (e.g., media source 510 shown in FIG. 2), Internet radiodevices (e.g., media source 510 shown in FIG. 2), WiFi phones, WiFi orother wirelessly enabled digital cameras (e.g., digital camera 522 shownin FIG. 2), facsimile machines, electronic picture frames, healthmonitors (sensor and monitoring devices), etc.

As described in greater detail herein, the gateway device 10 includesboth a hardware and software infrastructure that enables a bridging ofthe WAN and LAN networks, e.g. a proxy function, such that control ofany digital endpoint device at the premises from the same or remotelocation is possible via the gateway device 10 using, optionally, asecure peer and presence type messaging infrastructure or othercommunications protocols, e.g. HTTPS. For example, via any presence andnetworking protocol capable device (i.e., IM—capable device) or client80 a, 80 b respectively connected with an Instant Messaging (IM) or XMPP(Extensible Messaging and Presence Protocol) network messaginginfrastructure, e.g. IM networks 99 a, 99 b such as provided by Yahoo,Microsoft (MSN), Skype, America Online, ICQ, and the like, shown forpurposes of illustration in FIG. 5, a user may access any type offunctionality at a subordinate digital endpoint device (e.g., digitalmedia device 35 and television 32, etc.) at the premises via the gatewaydevice 10 and service management center 50 by simple use of peer andpresence messaging protocols. In one exemplary embodiment, a peer andpresence communications protocol may be used such XMPP (ExtensibleMessaging and Presence Protocol). Particularly, streaming XML protocolsand technologies enable any two entities on the Internet to exchangemessages, presence, and other structured information in close to realtime. The Internet Engineering Task Force (IETF) has formalized the coreXML streaming protocols as an approved instant messaging and presencetechnology under the name of XMPP, the XMPP specifications of which areincorporated by reference herein as IETF RFC 3920 and RFC 3921. Thus,the gateway device is provided with functionality for enabling a user toremotely tap into and initiate functionality of a digital endpointdevice or application at the premises via the IM-based messagingframework. In addition, the gateway device 10 and network connectivityto the novel service management center 50, provides, in a preferredembodiment, a secure peer and presence messaging framework, enablingreal-time communications among peers via other gateway devices 10.sub.1. . . 10.sub.n. For instance, the device 10 provides the ability toconstruct communication paths between peers with formal communicationsexchanges available between, for example, one gateway device 10.sub.1 ata first premises and a second gateway device 10.sub.n located at theremote premises. Thus, such an infrastructure provides for contentaddressing, enabling peers through remote gateway devices 10.sub.1 . . .10.sub.n. to supply and request content such as files, media content orother resources of interest to a community of interest.

As noted above, the novel system architecture allocates the logicalfunctionality of the ASD Platform (FIG. 1) between the gateway device 10and the service management center 50 within an environment that enablescommunication and feedback at the AS Layer (FIG. 1) between the gatewaydevice 10 and service management center 50. Thus, the gateway device 10,when operable with the service management center 50, makes possible themanagement of services for the digital home and facilitates the easyaddition of new services or modification of existing services. Suchservices may include, for example, facility management (homeautomation), media content downloading and Digital Rights Management(DRM), device updates, data backups, file sharing, media downloading andtransmission, etc., without the intermediary of a plurality of externalservice providers who may typically provide these individual servicesfor every digital endpoint device in the home or premises. Theprogramming for these services resides in the Application ServiceProvider Managed Applications and Platform of the UNA-DA (FIG. 4). Thatis, as earlier shown, the gateway device 10 is integrated with hardwareand software modules and respective interfaces that handle all aspectsof home automation and digital endpoint service and management for thehome in a manner without having to rely on external service providersand, in a manner that is essentially seamless to the user. This,advantageously is provided by the service management center 50 which isable to access regions of the gateway device 10 that are not accessibleto the user, e.g. for controlling the transport and storing of digitalcontent and downloading and enabling service applications and upgradesand providing largely invisible support for many tasks performed byusers.

For example, with the robust capabilities of the Application ServiceProvider Managed Applications and Platform (FIG. 4), the gateway device10 is capable of handling all aspects of the digital homecommunications, e.g. IP, voice, VoIP, phone connectivity. In thisexample, the service logic located and stored at the gateway device 10may provide soft-switch functionality for implementing call-processingfeatures at the premises (rather than the network) for voicecommunications, and enabling management of other service features to bedescribed. With the provision of central office type call services andother service features provided at the gateway devices 10.sub.1 . . .10.sub.n, a distributed soft-switch architecture is built. The ASMlogical functionality of the service management center 50, incooperation with the ASE logical functionality of the gateway device,may, among other things, provide, manage and regulate, for example,service subscription/registration, authentication/verification, keymanagement, and billing aspects of service provision, etc. With all ofthe service logic and intelligence residing at the gateway device, aservice provider can offer customers a broad spectrum of servicesincluding, but not limited to: media services, voice services, e.g.VoIP, automated file backup services, file sharing, digital photomanagement and sharing, gaming, parental controls, home networking, andother features and functions within the home or premises (e.g. homemonitoring and control). Users can access their content and many of thesolution's features remotely. Moreover, software updates for the in-homedevices that require updating are handled in an automated fashion by thesystem infrastructure. The service management center infrastructureadditionally provides a web interface for third-party service providersto round out the service solutions provided at the gateway device forthe premises. For example, a third-party service provider other than themanaged service provider associated with the service management centermay be allowed access through the infrastructure to particular endpointdevices to provide additional services such trouble shooting, repair andupdate services.

Gateway Device Software and Hardware Architecture

The composition of the premises gateway device 10, earlier describedwith reference to FIG. 4, is now described in greater detail withreference to FIGS. 6A-6D. As shown in FIG. 6A, the gateway device 10utilizes a layered architecture 100, which enables the encapsulation ofsimilar functionality and the minimization of dependencies betweenfunctions in different layers. FIGS. 6B and 6C depict exemplaryfunctionality (hardware and logical) resident in, or corresponding to,each of the layers shown in FIG. 6A. The layers include a hardware layer102, and device driver software 104 for allowing the processor tooperate other hardware elements of the gateway device 10. FIG. 6D is afunctional block diagram illustrating interconnection of exemplaryelements of the hardware layer 102. The logical elements of the NI Layerresiding on the gateway device 10 (FIG. 5) are found in the HardwareDrivers 104 which govern the operation of the Hardware Components 102.The processor runs an operating system shown at layer 106, which plays arole in each of the NI, NF, AS and Platform Management Layers (FIG. 1).The layered architecture 100 also includes software for systems services108 and for the platform management layer shown at 110 in this drawing.Logical elements represented by the NF Layer depicted in FIG. 1 arecomprised of elements from the system services 108 of FIG. 5. In asimilar fashion, the Platform Management Layer depicted in FIG. 1 isimplemented in the exemplary architecture of FIGS. 6A-6D by the platformmodules 109 and the platform management layer 110.

Particular logical elements comprising the ASL and ASE functionalitiesof the AS Layer represented in FIG. 1, and that reside on the gatewaydevice 10 (predominately in the Application Service Provider ManagedApplications and Platform of the UNA-DA shown in FIG. 4) are depicted inFIG. 6C, and comprise logical elements from each of services framework120 and application services 130. The layered architecture in FIG. 6Cfacilitates reuse or sharing of logic across the layers to provide amanaged service framework 120. The service management functionalityprovided by the framework 120 enables deployment of new services aspluggable modules comprising computer readable instructions, datastructures, program modules, objects, and other configuration data, in aplug and play fashion. The layered service architecture 100 additionallyprovides the gateway device 10 with intra-process communication andinter-process communication amongst the many services and modules in theservice framework layer 120 that enables the provisioning, managementand execution of many applications and services 130, depicted e.g.services A, B . . . N at the gateway device 10. Additionally providedare the application service interfaces 140 that enable communicationsfrom user endpoint devices with service environments. In that regard,the interfaces 140 enable the application service logic 130 to act as anappropriate server with respect to client device application or servicefunctionality of the endpoint devices (e.g., digital media device 35 andtelevision display 32 shown in FIG. 2, etc.). The application serviceinterfaces 140 also enable corresponding interfaces for the applicationservices with aspects of service environments implemented outside theuser premises. In that regard, the interfaces 140 enable the applicationservice logic 130 to act as an appropriate client, for extending theapplication or service related communications to a server accessed viathe wide area network 99, such as a server of the service managementcenter 50. For example, the gateway device may appear as a SIP server toa SIP client in an end point device, e.g. for a VoIP telephone service;but the gateway device will appear as a SIP client with respect to somerelated functions provided by a server (such as a SIP directory server)provided by the service management center 50.

FIG. 6A thus depicts a high level service framework upon which are builtservices, e.g. downloaded via the service management center network 50and wide area network 99 as packages that are developed and offered by aservice entity for customers. These services may be offered as a part ofa default service package provisioned and configured at the gatewaydevice 10, or provisioned and configured subject to user subscriptionand may be added at any time as plug-in service modules in cooperationwith the service management center 50. It is understood however, thatwhile the gateway device 10 includes much of the intelligence or servicelogic for providing various services, it is also possible that for someservices, some or all of service logic may reside in the servicemanagement center network and/or with a third party provider.

As shown in more detail in FIGS. 6B and 6D, the base support layer 102comprises hardware components including a processor device 152, e.g. asystem on chip central processing unit (“CPU”) that includes processingelements, digital signal processor resources and memory. The CPU 152 isalso coupled to a random access memory (“RAM”) and additionally,non-volatile hard drive/disk magnetic and/or optical disk memory storage154. Generally, the above-identified computer readable media providenon-volatile storage of computer readable instructions, data structures,program modules, objects, service configuration data and other data foruse by the gateway device. The non-volatile hard drive/disk magneticand/or optical disk memory storage 154 may be partitioned into a networkside which is the repository for storing all of the service logic anddata associated with executing services subscribed to by the user, and,is invisible to the user, and, a user side for storing user generatedcontent and applications in which the user has visibility. Although notshown, the CPU 152 may be coupled to a microcontroller for controlling adisplay device.

Additional hardware components include one or more Ethernet LAN and WANinterface cards 155, 156 (e.g. 802.11, T1, T3, 56 kb, X.25, DSL or xDSL)which may include broadband connections (e.g. ISDN, Frame Relay, ATM,Gigabit Ethernet, Ethernet over SONET, etc.), wireless connections, orsome combination of any or all of the above. The card 155 referred to asthe LAN interface card provides data communication connectivity withinthe user premises, essentially, for communication via a user premisesnetwork 60 with any endpoint devices operating within the premises. Thecard 156 referred to as the WAN interface card provides datacommunication connectivity for the gateway device 10 and endpointdevices communicating through the device 10, with the wide area IPnetwork 99. For additional or alternative customer premisescommunications, the hardware components 102 may also include one or moreUSB interfaces 158; and for additional or alternative communicationswith the wide area network, the hardware components may also include thePCMCIA EvDO interface card 160.

A data encryption/decryption unit 162 is additionally provided as partof the architecture for providing data security features. A watchdogtimer element or like timer reset element 164 is provided as is one ormore LED devices 166 for indicating status and other usable informationto users of the gateway device 10.

As mentioned above, the gateway device provides an in-premises footprintenabling the service connectivity and local management to client(s). Theimplementation of functions and the related control such as a router(with quality of service (QoS)), firewall, VoIP gateway, voice servicesand voice mail may be embodied and performed within the CPU 152.

The discussion of the gateway hardware layer above and the illustrationthereof in the drawings provides a high-level functional disclosure ofan example of the hardware that may be used in the gateway device. Thoseskilled in the art will recognize that the gateway device may utilizeother hardware platforms or configurations.

Continuing, as shown in FIG. 6B, the device driver layer 104 comprises amultitude of driver interfaces including but not limited to: a PCMCIAdriver 104 a, for enabling low level communication between the gatewayCPU 152 and the PCMCIA network interface card wireless interface, an IDEdriver 104 b for enabling low level communication between the gatewayCPU 152 and the local mass memory storage element, and LAN/WAN drivers104 c for enabling low level communication between the gateway CPU 152and the respective network interface cards 155 and 156. The exemplarydriver layer also includes an LED driver/controller 104 d for drivingLED(s) 166, a USB driver 104 e allowing CPU 152 to communicate via USBinterface 158, and an 862.11 big (or n) wireless network driver 1041 forallowing the CPU 152 to communicate via the access point 62. The driversprovide the logical connectivity between the low level hardware devices102 and the operating system 106 which controls the execution ofcomputer programs and provides scheduling, input-output control, fileand data management, memory management, and communication control andrelated services for the gateway device. With respect to the operatingsystem 106, the gateway computing may support any embedded operatingsystem, any real-time operating system, any open source operatingsystem, any proprietary operating system, or even any operating systemsfor mobile computing devices as long as the operational needs of theclient discussed herein below can be met. Exemplary operating systemsthat may be employed include Windows®, Macintosh.degree., Linux or UNIXor even an embedded Linux operating system. For instance, the gatewaydevice 10 may be advantageously provided with an embedded operatingsystem 106 that provides operating system functions such as multiplethreads, first-in first-out or round robin scheduling, semaphores,mutexes, condition variables, message queues, etc.

Built upon the system operating system 106 is a system services supportlayer 108 providing both client-like and server-like functions thatenable a wide range of functionality for the types of services capableof being managed by the gateway device 10. For instance, there isprovided a Dynamic Host Configuration Protocol (DHCP) client and serversoftware modules. The DHCP client particularly requests via a UDP/IP(User Datagram Protocol/Internet Protocol (e.g. Ipv4, Ipv6, etc.)configured connection information such as the IP address that thegateway device 10 has been dynamically assigned by a DHCP service (notshown), and/or any the subnet mask information, the gateway deviceshould be using. The DHCP server dynamically assigns or allocatesnetwork IP addresses to subordinate client endpoints on a leased, e.g.timed basis. A Virtual Private Network (VPN) client may communicate viaa proxy server in the service control network 50, according to a VPNprotocol or some other tunneling or encapsulation protocol. An SMPTclient handles incoming/outgoing email over TCP, in accordance with theSimple Mail Transfer protocol. A Network Time Protocol (NTP) (RFC 1305)generates and correlates timestamps for network events and generallyprovides time synchronization and distribution for the Internet. ADomain Name Server (DNS) client and server combination are used by theIP stack to resolve fully-qualified host or symbolic names, i.e. mappinghost names to IP addresses.

An HTTP(S) server handles secure Hypertext Transfer Protocol (HTTP)(Secure Sockets Layer) communications and provides a set of rules forexchanges between a browser client and a server over TOP. It providesfor the transfer of information such as hypertext and hypermedia, andfor the recognition of file types. HTTP provides stateless transactionsbetween the client and server.

A Secure File Transfer Protocol (SFTP) client and server combinationgovern the ability for file transfer over TCP. A SAMBA server is an opensource program providing Common Internet Files Services (CIFS)including, but not limited to file and print services, authenticationand authorization, name resolution, and service announcement (browsing).An EvDO/PPP driver includes a Point-to-Point Protocol (PPP) daemonconfiguration for wireless broadband services. A PPPoE (Point-to-PointProtocol over Ethernet) client combines the Point-to-Point Protocol(PPP), commonly used in dialup connections, with the Ethernet protocol;and it supports and provides authentication and management of multiplebroadband subscribers in a local area network without any specialsupport required from either the telephone company or an Internetservice provider (ISP). The gateway device 10 is thus adapted forconnecting multiple computer users on an Ethernet local area network toa remote site through the gateway and can be used to enable all users ofan office or home to share a common Digital Subscriber Line (DSL), cablemodem, or wireless connection to the Internet. A Secure Shell or SSHserver implemented with HTTP protocol provides network protocolfunctionality adapted for establishing a secure channel between a localand a remote computer and encrypts traffic between secure devices byusing public-key cryptography to authenticate the remote computer and(optionally) to allow the remote computer to authenticate the user.

Additionally provided as part of the system services layer 108 isintelligent routing capability provided by an intelligent router device185 that provides Quality of Service (QoS, guaranteed bandwidth)intelligent routing services, for example, by enforcing routing protocolrules and supporting unlimited multiple input sources and unlimitedmultiple destinations and, particularly, for routing communications tonetworked digital endpoint devices subordinate to the gateway. A centraldatabase server 183 handles all of the database aspects of the system.For example, the database server 183 maintains and updates registriesand status of connected digital endpoint devices, maintains and updatesservice configuration data, services specific data (e.g. indexes ofbacked-up files, other service specific indexes, metadata related tomedia services, etc.) and firmware configurations for the devices. Thedatabase server 183 may also store billing and transaction detailrecords and performance diagnostics. The database server logic 183 alsosatisfies all other database storage needs as will be described ingreater detail herein.

Referring back to FIGS. 6A and 6B, built on top of the system serviceslayer 108 is the platform module layer 109. The platform module layer109 provides a software framework for operating system andcommunications level platform functionality such as CPU management;Timer management; memory management functions; a firewall; a web wallfor providing seamless WWW access over visual displays via accesstechnologies enumerated herein, e.g. HTTP, SMS (Short Messaging Service)and WAP (Wireless Access Protocol); QoS management features, bandwidthmanagement features, and, hard disk drive management features. Thelayered architecture 100 further provides a platform management layer110 as shown in FIG. 6C, which together with the platform modules 109implement the platform management layer/logic discussed earlier (withregard to FIG. 1).

The features/functions in the layer 110 include a platform managermodule which will implement unique rules based notification services. Onoperational failure, for example, when one of the components or servicesfails, the platform manager would detect this failure and takeappropriate action such as implement a sequence of rules to providenotification to a user. A scheduler module manages scheduled devicemaintenance, managing scheduled services, e.g. back-up services, etc.The layer 110 also includes a diagnostics module and a firmware upgradesmanagement module for managing firmware upgrades. A resource managementmodule manages system resources and digital contention amongst thevarious resources, e.g. CPU/Bandwidth utilization, etc. A displaymanagement module and a logger management module store and track gatewaylog-in activity of users and applications, e.g. voice call logs, at theuser premises. The platform management layer 110 in concert withresource and service management components enforces the separation ofnetwork side managed service control and user side delegations dependingupon service subscriptions and configurations. For example, the platformand resource management encompass rules and guidelines providedaccording to subscribed services that act to enforce, manage and controlinput/output operations, and use of hard drives space, etc. Ademarcation point, logically depicted as the Application ServiceProvider Demarcation in FIG. 4, is thus defined that provides a hardline between what is owned by the customer and what is owned by theservice provider.

The logical platform management layer 110 allows for inter-layerallocation of local resources. This function guarantees access betweenthe application service/management logic implemented at the higherlayers in the gateway device 10 and the applications service managementfunction in the service management center 50, by assuring that the localuser premises hardware and software modules are functioning at arequired state (CPU and memory usage, bandwidth usage, QoS settings,etc.). The platform manager is also responsible for implementing thatpart of the managed application services to be performed by the gatewaydevice. In that regard, the platform manager secures and manages theoverall hardware platform, given that in this scenario, the networkfunction layer and the application service layer reside on one hardwareplatform. This secure hardware platform provides a robust and secureoperating environment for the application services layer. So, toestablish a secure and robust hardware operating environment, theplatform management layer must interface with all the layers above itand allow for bi-directional management information flow among all ofthe functions.

Referring back to FIGS. 6A and 6C, built on top of the platformmanagement layer 110 is the Services Framework 120, which provides alibrary of application support service processes that facilitate datacollection and data distribution to and from the multimedia endpointdevices. The application support service processes include, but are notlimited to: an authentication manager for use in authenticating devicesconnected to the gateway device; a billing manager for collecting andformatting service records and service usage by endpoint devices, e.g.calls, back-up services etc.; a fault manager for detecting and managingdetermined system and/or service faults that are monitored and used forperformance monitoring and diagnostics; a database manager; a controlchannel interface via which the gateway initiates secure communicationswith the operations support infrastructure; a configuration manager fortracking and maintaining device configuration; a user manager; a servicemanager for managing service configuration and firmware versions forsubscribed services provided at the gateway device; and a statisticsmanager for collecting and formatting features associated with thegateway device. Statistics may relate to use of one or more services andassociated time-stamped events that are tracked.

Built on top of the Services Framework layer 120 is the ApplicationServices layer 130 providing library of user application services andapplication support threads including, but not limited to: file sharingfunctionality; backup services functionality; home storagefunctionality; network device management functionality; photo editingfunctionality; home automation functionality; media servicesfunctionality; call processing functionality; voice mail and interactivevoice response functionality; presence and networking functionality;parental control functionality; and intelligent ads managementfunctionality. The multi-services applications gateway 10 furtherprovides application service interfaces 140 that are used to enable avariety of user applications and communications modalities.

For instance, the SIP Interface 141 is an interface to the generictransactional model defined by the Session Initiation Protocol (SIP)that provides a standard for initiating, modifying or terminatinginteractive user sessions that involve one or more multimedia elementsthat can include voice, video, instant messaging, online games, etc., byproviding access to dialog functionality from the transaction interface.For instance a SIP signaling interface enables connection to a SIPnetwork that is served by a SIP directory server via a Session BorderController element in the service management center 50 (FIG. 5).

The Web Interface 142 enables HTTP interactions (requests and responses)between two applications. The Web services interface 149 provides theaccess interface and manages authentication as multi-services gatewaydevices access the service management center 50 (FIG. 5) via webservices. The IM Interface 144 is a client that enables themulti-services gateway device 10 to connect to one or more specific IMnetwork(s). As further shown in FIG. 6C, the UpNp (Universal Plug andPlay) interface enables connectivity to other stand-alone devices andPCs from many different vendors.

The XMPP interface 145 is provided to implement the protocol forstreaming (XML) elements via the gateway device 10, in order to exchangemessages and presence information in close to real time, e.g. betweentwo gateway devices. The core features of XMPP provide the buildingblocks for many types of near-real-time applications, which may belayered as application services on top of the base TCP/IP transportprotocol layers by sending application-specific data qualified byparticular XML namespaces. In the example, the XMPP interface 145provides the basic functionality expected of an instant messaging (IM)and presence application that enable users to perform the followingfunctions including, but not limited to: 1) Exchange messages with otherusers; 2) Exchange presence information with other devices; 3) Managesubscriptions to and from other users; 4) Manage items in a contact list(in XMPP this is called a “roster”); and 5) Block communications to orfrom specific other users by assigning and enforcing privileges tocommunicate and send or share content amongst users (buddies) and otherdevices.

As noted, FIG. 6D provides a functional block diagram of exemplaryelements of the hardware layer 102. For example, a system on a chipprovides the CPU 152 and associated system components. The CPU 152 isalso coupled to a random access memory (“RAM”) and flash memory. Thesystem on a chip also includes a hard drive controller for controlling ahard disk drive, and together the controller and drive form the harddisk example of the storage 154. An Ethernet switch and associated LANport(s) provide the Ethernet LAN interface 155; and the Ethernet switchand associated WAN port provide a landline implementation of the WANinterface 156L, for connection to a broadband modem or the likeimplementing the NSP-TA. The WAN interface may also be wireless, asimplemented at 156 w for example by a wireless WAN module and associatedantenna. An example of such an interface would be the EvDO interfacediscussed earlier. If the gateway device uses the wireless WAN interface156 w, there would be no separate NSP-TA.

In the example of FIG. 60, a USB controller in the system on a chip andone or more associated USB ports provide the USB interface 158. The USBinterface 158 may provide an alternate in-premises data communicationlink instead of or in addition to the wired or wireless Ethernet LANcommunications. The system on a chip includes a security engine, whichperforms the functions of the data encryption/decryption unit 162.

The hardware layer 102 may also include an option module. The UNA-DAhardware components at layer 102 have multiple interfaces for connectionto such an option module. These interfaces, by way of example, could bea data bus (e.g. PCI, etc), network interface (e.g. Ethernet (RJ45),MoCA/NPNA (Coax)) and Power feeds. The option module allows additionalfunctionality to be added to the base UNA-DA functionality of thegateway device. For example, this additional functionality could beeverything from support for a variety of extra Wide Area Networkinterfaces (e.g. xDSL, DOCSIS, Fiber (PON), Cellular Packet, WIMAX,etc.), Media Processing (e.g. Cable TV termination, Digital VideoRecording, Satellite TV Termination, etc), to Voice Processing (FXS,FXO, Speech Detection, Voice to Text, etc). The option module may haveits own standalone CPU, Memory, I/O, Storage, or provide additionalfunctionality by its use of the CPU, Memory. I/O, and storage facilitiesoff of the main hardware board. The option module may or may not bemanaged directly by the Platform Management of the UNA-DA.

Gateway Processing

For the in-home services, the mufti-services gateway device 10 connectsthe various service delivery elements together for enabling the user toexperience a connected digital home, where information from one source(for example, voicemail) can be viewed and acted on at another endpoint(for example, the TV 32). Various application services available viagateway device 10 may be provided to endpoint devices (e.g., TV 32) viadigital media device 35. The multi-services gateway device 10 thus hoststhe various in-home device interfaces, and facilitates the moving ofinformation from one point to another. Digital media device 35 maycollaboratively operate gateway device 10 to provide services toendpoint devices communicatively coupled to digital media device 35.

Some of the in-home endpoint device processing duties performed by thegateway device 10 include, but are not limited to: 1) detecting newdevices and provide IP addresses dynamically or statically; 2)functioning as a (Network Address Translator) NAT, Router and Firewall;3) providing a centralized disk storage in the home; 4) obtainingconfiguration files from the service management center and configuringall in-home devices; 5) acting as a Registrar for SIP-based devices; 6)receiving calls from and delivering calls to voice devices; providingvoicemail services; 7) decrypting and securely streaming media havingdigital rights management (DRM) encoding; 8) distributing media to anappropriate in-home device; 9) compressing and encrypting files fornetwork back-up; 10) backing-up files to the network directly fromgateway device; 11) handling home automation schedules and changes instatus; 12) providing in-home personal web-based portals for each user;13) providing Parental Control Services (e.g. URL filtering, etc.); 14)creating and transmitting billing records of in-home devices including,recording and uploading multi-service billing event records; 15)distributing a PC client to PCs in the home, used in support of thevarious services such as monitoring events or diagnostic agents; 16)storing and presenting games that users and buddies can play; 17)delivering context-sensitive advertising to the endpoint device; and,18) delivering notifications to the endpoint device; and, 19) enablingremote access through the web, IM client, etc. Other duties the gatewaydevice 10 may perform include: service maintenance features such assetting and reporting of alarms and statistics for aggregation; performaccessibility testing; notify a registration server (and Locationserver) of the ports it is “listening” on; utilize IM or like peer andpresence communications protocol information for call processing andfile sharing services; receive provisioning information via theregistration server; utilize a SIP directory server to make/receivecalls via the SBC network element to/from the PSTN and other gatewaydevice devices; and download DRM and non-DRM based content andfacilitating the DRM key exchanges with media endpoints.

Gateway to Gateway Device Communications

As mentioned earlier, the gateway devices and service management centersupport a communication capability between the appliances. This feature,for example, may be utilized for enabling secure peer-to-peer sharing ofdata between or among the gateway appliances.

Additional aspects of the peering capabilities enabled by the gatewaydevice-service management architecture include the ability to store aroster or contact list of distant gateways on either the gateway 10 orwithin the service management center 50 and utilizing these addresses tomaintain the presence and routing information of selected othergateways. This roster information is used to establish and manage accessand message routing, via XMPP messaging, to gateways, to locate andaddress other gateways, and set up peering relationships between thegateways.

A gateway may also expose other details about resources or endpointswithin the home to other gateways by communicating resource informationalong with presence information. As an example, a gateway may sendpresence information to selected “buddies” via the signaling channel andalso include information about the resources available to the distantbuddy. Examples of resources include digital picture frames that thedistant gateway user may direct photos to, web cams, or other resources,enabling direct interaction between an end user connected to onegateway, or in automated scenarios, the gateway itself, and a distantdevice connected to the local area network of another gateway.

When a user interacts with the resource sharing functions of theirgateway 10, the user may select a specific gateway 10.sub.1 from theirroster, represented as a “buddy” list. When the user selects a “buddy”,additional resource details are displayed to the user, providinginformation about any resources that the end user may utilize via thatselected peer gateway device 10.sub.1.

The XMPP messaging protocol, combined with the roster and XMPPaddressing mechanisms may be utilized for either end user interactionsor automated interactions between gateways. Automated use of the peeringcapabilities include directing utility data for usage and networkmanagement information to designated collectors within peering groupsand then having the designated collector forward the combinedinformation to the service management center. This distributes thecollection processing to the gateways and decreases the overallprocessing and bandwidth utilization in the service management center.Of course, the XMPP protocol is discussed here merely by way of example,and those skilled in the art will recognize that the gateway to gatewaydevice communications may use other protocols.

Various media device operations as well as the gateway device 10 and itsinteractions with the digital media device 35, various other endpointdevices, and with the service management center 50 have been describedwith reference to diagrams of methods, apparatus (systems) and computerprogram products. It will be understood that elements and functionsillustrated in the diagrams, can be implemented by computer programinstructions running on one or more appropriately configured hardwareplatforms, e.g. to operate as a digital media device 35, a gatewaydevice 10 or as one or more elements of the service management center50. Hence, operations described above may be carried out by execution ofsoftware, firmware, or microcode operating on a computer otherprogrammable device of any type. Additionally, code for implementingsuch operations may comprise computer instruction in any form (e.g.source code, object code, interpreted code, etc.) stored in or carriedby any computer or machine readable medium.

Graphical User Interface (GUI)

FIG. 8A illustrates an exemplary graphical user interface 820, which mayprovide service and media selections for a user. These selectableservices and media options may be managed by gateway device 10, based atleast in part on applications, services, and/or media sources that auser may have subscribed to. Additionally, some selections may be basedin part on media sources (e.g., media source 510), storage devices(e.g., devices 522, 524, or 526, etc.) communicatively connected to thedigital media device 35. Gateway device 10, or a combination of gatewaydevice 10 and digital media device 35, may provide the exemplarygraphical user interface 820 for presentation to a user on televisiondisplay 32.

As illustrated in FIG. 8A, interface 820 may be presented by digitalmedia device 35 for display on television display 32 to users. As shown,interface 820 may have an arrangement of graphical icons 822 in apattern. The pattern, which is substantially curved as shown in FIG. 8A,may have first end 824 and second end 826, with first end 824 and secondend 826 each defined by a display edge of the television display. Eachgraphical icon 822 may represent a media application, serviceapplication, or media and service application. Examples of applicationsrepresented by icons include music, video, pictures, home automation,games, phone and messaging, parental control, or any other suitableapplications. Some graphical icons 822 may represent media applicationsthat may be provided by a media source such as media source 510, fromstorage devices 520 (e.g., digital camera 522, flash memory 524, PMPdevice 526, etc.), or from other devices via interfaces 650, 660, 670,680 of media device 35. Some graphical icons 822 may represent mediaapplications, service applications, or media and service applicationsprovided via gateway device 10.

Using a remote control or other control device, a user may highlight oneof the graphical icons 822 located substantially a center 828 (e.g., theapex of the curve) of the pattern to enable selection of the onegraphical icon. Digital media device 35 may receive a selection from aremote (e.g., remote 550) to move the arrangement graphical icons in afirst direction or a second direction (e.g., in the curved pattern shownin FIG. 8A, the graphical icons may be moved rotationally in a clockwiseor counterclockwise direction). After movement of icons 822, one or moreof the graphical icons 822 may be different, where the movement of thearrangement of icons 822 enables at least one graphical icon to berotated beyond the display edge and the one or more previously hiddenicons to enter the display area. After movement, the graphical iconlocated substantially at the center of the pattern may be in a positionto enable selection (e.g., the apex of a curved pattern shown). Digitalmedia device 35 may receive a selection of the highlighted icon for atleast one media application, service application, or media and serviceapplication. The selected media application, service application, ormedia and service application may be displayed on the television display32. More specifically, upon receiving a selection of the highlightedicon, digital media device 35 executes programming to provide theservice application from gateway device 10 to digital media device 35via a user premises data communications network (e.g., a wireless orwired communication system).

Upon receiving a selection of the highlighted icon, digital media device35 executes programming to enable digital media device 35 to provide themedia application, service application, or media and serviceapplication. Depending on the media application, service application, ormedia and service application selected, the digital media device mayenable a device (e.g., media source 510, etc.), gateway 10, anotherdigital media device communicatively coupled to network 99, to providethe selected application to digital media device 35. Alternatively, uponreceiving a selection of a highlighted icon, digital media device 35 maydisplay a screen related to the selected icon to provide access toadditional applications and/or services related to the selection. Forexample, selection of a highlighted icon may display: scratchpadfunctionality GUI screen illustrated in FIG. 9B; one or more of thebackup GUI screens illustrated in FIGS. 10A-10; one or more of the filesharing GUI screens illustrated in FIGS. 11A-11B; and/or one or more ofthe home automation GUI screens illustrated in FIGS. 12A-121. Thesescreens may, for example, be inserted or overlaid onto a video-typepresentation presented on television display 32 (shown in FIG. 2), ormay fully occupy the display area of television display 32.

Digital media device 35 may also provide the media application, serviceapplication, or media and service application from memory 602 or digitalstorage device 604 (illustrated in FIG. 3). In addition, digital mediadevice 35 may be enabled to provide the media application, serviceapplication, or media and service application received via wirelessnetwork interface 650 or wired network interface 660 (illustrated inFIG. 3). The execution of the programming embodied on digital mediadevice 35 may dynamically add or remove one or more graphical icons fromthe arrangement of graphical icons 822 in the pattern (e.g., thesubstantially curved pattern shown in FIG. 8A). The dynamic adding orremoving of the one or more icons may be, for example, determined bysubscriptions to media applications, service applications, or media andservice applications. The dynamic adding or removing of the one or moreicons may also be provisioned by gateway device 10. Additionally, thedynamic adding or removing of icons may relate to the availability ofdirectories of content hosted by gateway device 10, memory 602 ordigital storage device 604 of digital media device 35 or another digitalmedia device connected to network 99, content servers communicativelycoupled to network 99, digital storage devices 520, or any othersuitable content hosted by devices communicatively coupled to digitalmedia device 35.

Alternatively, as illustrated in FIG. 8B, graphical icons 830, similarto graphical icons 822 shown in FIG. 8A, may be overlaid on a displayscreen 832 in a substantially linear arrangement. Icons 822 shown inFIG. 8A or icons 830 shown in FIG. 6B may have either a substantiallycurved or substantially linear arrangement. A signal from at least onemedia source may be the primary image on display screen 832, and thearrangement of graphical icons 830 may be a secondary image overlaidonto the primary image 832.

The substantially linear arrangement of graphical icons shown in FIG. 8Bmay have first end 834 and second end 836, with first end 834 and secondend 836 each defined by a display edge of the television display. Eachgraphical icon 830 may represent a media application, serviceapplication, or media and service application. Examples of applicationsrepresented by icons include music, video, pictures, home automation,games, phone and messaging, parental control, or any other suitableapplications. Some graphical icons 830 may represent media applicationsthat may be provided by a media source such as media source 510, fromstorage devices 520 (e.g., digital camera 522, flash memory 524, PMPdevice 526, etc.), or from other devices via interfaces 650, 660, 670,680 of media device 35. Some graphical icons 830 may represent mediaapplications, service applications, or media and service applicationsprovided via gateway device 10.

Using a remote control or other control device, a user may highlight oneof the graphical icons 830 located substantially a center 838 of thesubstantially linear pattern to enable selection of the one graphicalicon. Digital media device 35 may receive a selection from a remote(e.g., remote 550) to move the arrangement graphical icons in a firstdirection or a second direction (e.g., in the substantially linearpattern shown in FIG. 8A, the graphical icons may be moved in a left orright direction). After movement of icons 830, one or more of thegraphical icons 830 may be different, where the movement of thearrangement of icons 830 enables at least one graphical icon to be movedbeyond the display edge and the one or more previously hidden icons toenter the display area. After movement, the graphical icon locatedsubstantially at the center (e.g., at center 838) of the linear patternmay enable selection. Digital media device 35 may receive a selection ofthe highlighted icon for at least one media application, serviceapplication, or media and service application. The selected mediaapplication, service application, or media and service application maybe presented on the television display 32 or audio-video system 530.More specifically, upon receiving a selection of the highlighted icon,digital media device 35 executes programming to provide the serviceapplication from gateway device 10 to digital media device 35 via a userpremises data communications network (e.g., a wireless or wiredcommunication system).

Upon receiving a selection of the highlighted icon, digital media device35 executes programming to enable digital media device 35 to provide themedia application, service application, or media and serviceapplication. Depending on the media application, service application, ormedia and service application selected, the digital media device mayenable a device (e.g., media source 510, etc.) or gateway 10 to providethe selected application to digital media device 35. Alternatively, asdescribed above, selection of the highlighted icon may presentadditional displays presenting selections for applications and/orservices related to the selected icon.

The execution of the programming embodied on digital media device 35 maydynamically add or remove one or more graphical icons from thearrangement of graphical icons 830 in the substantially linear pattern.The dynamic adding or removing of the one or more icons may be, forexample, determined by subscriptions to media applications, serviceapplications, or media and service applications.

For ease of operation, the gateway device provides a GUI interface thatsupports functional test, diagnostics and control capabilities foritself and for the other home network devices that it communicates with.The test and diagnostics include connection and bandwidth tests,statistics and alarms (alerts) for use by service support centers andusers. The control capabilities include automated configuration andmanagement. To this end, users of gateway device 10.sub.1, . . . ,10.sub.n access the Web/Internet via a personal computer/computingdevice, mobile or laptop computer, personal digital assistant, or likedevice implementing web-browser functionality, e.g., Firefox 1.5 andInternet Explorer® 6.0 or later, or other browsing technology that maybe compatible. In an exemplary embodiment, the browser interface employsthe user interaction techniques, e.g., Web 2.0, and implements webdevelopment technologies such as AJAX (Asynchronous JavaScript and XML).

With respect to accessing the gateway device 10 and services fromservice management center 50 via an interface (e.g., web interface,etc.), or accessing media and/or services from devices communicativelycoupled to digital media device 35, users may, for example, log-in to ahome page screen (not shown) via a web-based communication or othersuitable network communication by entering a username and a password.Upon submitting this login information, both the username and passwordmay be validated. If either the username or password is invalid, then anappropriate error message may be displayed explaining the nature of theerror. If the login is successful, and the gateway appliance has alreadybeen initialized, a user's personal page will be loaded by default whichpage is user is configurable. For purposes of illustration, a user “HomeCenter” screen is displayed as shown in FIG. 9A that depicts an exampleadministrator's page 700. Common to any page may be header 702, where atitle of the screen is indicated, a content display area 705, and, asystem's status indication displayed indicating the present functionalcapability of the system. A tooltip functionality may be provided formore details regarding system status. If the status is, for example,red, the user can select the status indicator to get a diagnostic screenwith a network map (not shown). This screen may display the currentstatus of all devices managed by the gateway appliance and includes abutton to allow the user to test the current status. A top bar may alsoused to indicate the progress status of any backup jobs currentlyrunning. A tooltip may be provided to indicate the schedule name and theprogress percentage. The top bar may also indicate the space usage ofthe user. A tooltip may be provided to indicate the percentage of thespace used by the user of the allocated space configured by theadministrator user. Various labels may be provided that display thecurrent user information (e.g., administrator), and a link to logout ofthe home center, or other suitable labels. When the user selects thelogout link, the users' web session will be invalidated and the loginpage will be displayed. Additional links may be provided to change theuser preferences. For example, when the user selects the “Preferences”link, a dialog box may be displayed to enable the user to change theuser preferences settings such as color, font, themes, or any othersuitable preference settings.

A list of home center icons 710 may be arranged on the header. When theuser selects an icon, the content area 705 may be replaced with thecontent selected feature. If a particular feature is not available, theicon will be grayed. If the feature represented by the icon is notavailable, then the icon may be, for example, grayed and a tooltip maybe provided to display an explanation. Although not shown, notificationsfor each feature may be displayed as an icon, which may be animated,below that feature in the second bar. A tooltip is provided with moredetails for each notification. When the user selects the notificationicon, detailed notification information may be displayed.

As shown in FIG. 9A, the list of user-selectable tabs or icons may beprovided that enable user interactivity with the services provided bythe gateway appliance or other device communicatively coupled to digitalmedia device 35. These icons include, but are not limited to: a PersonalPage icon 714 that displays the personal page allowing a user toorganize and configure a set of useful “widgets” provided by the gatewaydevice; a Photos icon 714 that displays a photos page allowing a user tobrowse stored images; a Music icon 716 that displays a music pageallowing a user to browse music stored; a File Sharing icon 718 thatdisplays a file sharing page allowing a user to view and manage theshared files with buddies; a Calendar icon 724 that displays a calendarpage allowing a user to manage their own calendar; a Phones icon 720that displays a “phones” page allowing a user to view and manage thelist of voicemail and call logs stored at the gateway appliance; aBackup icon 726 that displays a backup page allowing a user to view andmanage the backups managed by the gateway appliance, and, a HomeAutomation icon 724 that displays a home automation page allowing a userto view and manage the home automation devices.

Backup Services GUI

As shown in FIG. 9A, upon selection of the Backup icon 726, backup page730, as shown in FIG. 10A, may be displayed. The backup page may enablea user to view and manage the backups managed by, e.g., the gatewayappliance. A title bar of the content area may display the total numberof backups performed by the gateway appliance, or any other relatedinformation. Search box 731 may be provided to enable the user to findany files that have been backed up. Each matched file may be displayedin a list with substantially all related metadata. The submenu on theright provides options for the user to access the backup history andschedules.

As shown in FIG. 10A, via backup page 730, in response to selecting aHistory option 732, a list or pop-up display may be generated to displaythe backup history data in a table with the following exemplarycolumns: 1) Schedule—the name of the backup schedule. When the userclicks on the name, a backup schedule screen will be displayed; 2)Status indicator—the status of the backup; 3) Files—the number of filesthat were backed up; 4) Date—The date and time the backup was done. Whenthe user selects the date, the backup details may be displayed to enablethe user to view the list of files that were backed up; 5) Size—thetotal size of the files that were backed up; 6) Type—the type of backup,e.g., Recurring—full backup of all files every time the backup runs, or,Once—immediate backups; and 6) Actions—the actions that can be done oneach backup. When the user dicks on the restore icon, all of the filesin the backup will be restored to their original location.

As shown in FIG. 10B, via backup page 730, in response to selecting aSchedules option 734, a list or pop-up display 735 may be generated todisplay the total number and types of scheduled backups. The contentarea lists the schedule data in a table with the an exemplary columnshaving the name of the backup schedule, or other exemplary columns. Whenthe user clicks on the name, the schedule details will be displayed sothat the user may modify the schedule; the Status indicator—the statusof the backup. For a backup in progress, a dynamic progress bar andpercentage indicator will be displayed; the Last Backup—the date andtime of the last backup for this schedule; the Next Backup—the date andtime of the next backup for this schedule; the Type—the type of backup,e.g., a recurring or full backup of all files every time the backupruns, or immediate backups, a single back-up or an incremental backup;and, the Actions that may be done on each schedule as implemented byselecting an icon from a group 736 of icons, e.g., a Stop icon, which,when selected, stops the current backup in progress. When the userselects the stop icon, the user may be prompted to keep the files thathave already been backed up; Pause/Start—pause the current backup inprogress or start a backup that is not in progress; a Report icon whichwhen selected, displays a report of the backup (report screen design);and, an icon for deleting the schedule. When the user selects the deleteicon, the user will be prompted to confirm the delete operation; and, animmediate Backup (i.e., backup now) option.

FIG. 10C depicts the resulting backup schedule screen 737 resulting fromselection of the “documents” backup name from the display depicted inFIG. 9A. Via this display, functionality may be enabled for the user toedit an existing schedule for each of the files and folders 738 managedby the schedule as displayed. The content area displays the currentschedule information. However, the user may change the schedule settingsand select the Update button to modify the schedule. Particularly, theuser may: change the list of files for the schedule; done and modify anexisting schedule; and/or change the list of files. It is understoodthat the file backup feature may be additionally integrated with use ofa Calendar application. The user may additionally select the Cancelbutton to return to the list of scheduled backups.

FIG. 10D depicts the resulting backup report display 739 resulting fromselection of the Report action icon from the screen depicted in FIG.10B. This enables the user to view a status report of a backup schedulewith the content area displaying the status information about the backupjob.

Filesharing Services GUI

Returning to FIG. 9A, upon selection of the FileSharing icon 718,exemplary filesharing page 740 may be displayed, as shown in FIG. 11A.The filesharing page enables a user to view and manage the shared files(shares) with buddies. The shares may grouped by the following exemplarytypes: files, photos, slideshows, playlists, tabs, etc. The submenu 742may enable the user to view the list of shares of each type. As shown inFIG. 11A, the shares may be displayed as a list 743 including, but notlimited to the name (e.g., documents), date created, date modified,expiration date and number of views for each share are displayed. Theshares may be sorted by each column by, for example, selecting theheader label for that column. The total number of shares of each typemay be displayed in the title bar of the content area (in displayed list743). FIG. 11A depicts an example screen display showing file typeshares displayed in list 743. The user may be additionally enabled todelete a share, e.g., by clicking on a “delete” icon (not shown). Forexample, by moving a mouse or other graphical control device over ashare name, an icon may be displayed that allows the user to delete theshare. The user can view the files that make up the share by selectingthe name link for each share.

Continuing to FIG. 11B, upon selection of the shares name, e.g.,documents, via example page 740 shown in FIG. 11A, there is displayed alist 745 of files of that shared the type, e.g., documents. The filesand folders in the share are displayed as a list and include athumbnail, the name, title, description, tags, date, size, buddy rating(which buddies downloaded the and when), and the total number ofcomments added by buddies are displayed. The title, description and tagscan be modified by inline editing. For folders, users can drill into thefolder item and then see the list of files shared in that folder. Thebuddies that make up the distribution list for the share may bedisplayed individually as shown in content area 744. Each buddy that hasnot viewed the share is highlighted. When a cursor is moved over a buddyname, an icon is displayed next to the name providing functionality toremove that buddy from the distribution list. There is a link next tothe list of names to add a new buddy. When the user selects the AddBuddy link, a list of other buddies may be displayed. The user mayselect which buddies to add from the list. The expiration date of theshare is additionally displayed. The user can change the expiration dateusing inline editing. Upon moving a displayed mouse cursor over an item,an icon is displayed to allow the user to remove the item from theshare. An icon is displayed next to the number of comments. When theuser selects the icon, the list of comments may be displayed inlinebelow the metadata of the shared file. The user may collapse thecomments by selecting the icon again.

Scratchpad GUI

Additional functionality may be implemented (e.g., adding items to theshare) by using a scratchpad which functions as a visual clipboard tocollect items which are used at a later time. To display the scratchpad,the user may select the Show Scratchpad link 747 in the header shown inexample display of FIG. 11B. Any items in the scratchpad can then bedrag-and-dropped onto the list of items, or selected in any othersuitable fashion, to add them to the share.

With respect to use of the scratchpad, as shown in FIG. 9B, a Show/HideScratchpad link may be provided to display the scratchpad (e.g., on theright side of the header). When the user selects the Show Scratchpadlink, a scratchpad area may be displayed on the right of the contentarea. The scratchpad may have window controls to maximize and minimizeits content area. Users may then drag-and-drop items from the contentarea 705 onto the scratchpad area, or select them for the content area705 in any other suitable manner. Items may also be added on otherdevices such as a TV, where the TV may be used to flag such an item. Anyoperations on the items in the scratchpad may be performed from the webGUI. Items may be displayed as thumbnails with metadata. When the usermoves a cursor over the thumbnail, a tooltip may be provided with thedetails for that item. In addition, each item in the scratchpad may havea link to remove it from the scratchpad.

Items in the scratchpad can be grouped into collections and the totalfiles size of the items in each collection is displayed. By default,there is a collection called “My Collection”. The user may change thename of the collection by using inline editing. When the user selectsthe New Collection link 711, a new collection boundary may be added tothe bottom of the scratchpad. Users may move items between collectionsby using drag-and-drop functionality, or other suitable functionality.Each collection may have a link to remove it from the scratchpad. Whenthe user right clicks on a collection, a context menu may be displayedproviding an option for sharing the files in the collection. A dialog(not shown) may be presented that displays the list of buddies to sharewith. A right-click context menu (not shown) additionally allows theuser to save the collection as a slideshow, photo album or as a musicplaylist depending on the type of items in the collection.

Home Automation Services GUI

Referring back to FIG. 9A, upon selection of the Home Automation icon724, a home automation page may be displayed, such as the example homeautomation screen 750 shown in FIG. 12A, that enables users to view andcontrol all of the devices managed by the gateway appliance, or,alternatively, manage devices communicatively coupled to digital mediadevice 35. As shown in FIG. 12A, in response to selecting a devicesoption 752 via home automation page 750, a list or pop-up display 755may be generated to display the following for the controlled devices: 1)the user defined name for the device. After the devices areautomatically detected, the gateway appliance will default the name tothe type. The user can modify the name by using inline editing; 2) aStatus indicator icon or label indicating the current status andpossible value of the device; 3) a user defined room in which the deviceis located. When the devices are automatically detected, the defaultroom will be the empty however, the user can change the default room byusing inline editing; 4) the manufacturer and type of device; and, 5)any actions that can be done on each device.

As shown in FIG. 12B, in response to selecting a rooms option 754 viahome automation screen 750, a list or pop-up display 760 may begenerated to allows the user to view and design one or more the rooms inthe house. A total number of rooms may be displayed and an icon may beprovided that enables the user to add a new room to the list. When theuser selects the add icon, a new room screen may be displayed. Thecontent area lists the rooms in a table with the following exemplarycolumns: 1) a user defined name for the room. The user can modify thename by using inline editing; and, 2) the floor on which room islocated. The user can change the default room by using inline editing;and, 3) the actions that can be done on each room, e.g., delete theroom. When the user moves a cursor over each room in the table, the roomplan is displayed inline.

As shown in FIG. 12C, via home automation screen 750, a user may edit anexisting room. The content area thus displays the current room name andfloor that the user can edit to change. As shown in FIG. 12C, thecontent area may display the layout editor 763 for the room thatincludes a list of icons for devices that can be drag-and-dropped on awork area for that room. The devices are grouped into categories thatmay be selected from a drop-down menu 764. When a category is selected,the icons for that category may displayed in the list. Once an icon isdropped onto the work area 765, it may be moved around, for example,using direct manipulation and be labeled by using inline editing. Anicon can be removed from the work area by using the delete option fromthe right-click menu or by dropping it outside of the work area (e.g.,by using the remote control 550). Each icon may have a status indicatorto see the current status of the device if it is managed by the gatewayappliance. The user may change the room settings and press an updatebutton to modify the group.

As shown in FIG. 12D, via home automation screen 750, a user may viewand control a plurality of the groups of devices created by the userupon selection of the group menu option 756. When the user selects thename for a device, the settings for that group will be displayed. Anicon is displayed to allow the user to add a new group to the list. Whenthe user clicks on the add icon, the new group screen will be displayedsuch as shown in FIG. 12E. Particularly, in FIG. 12D, the content areaprovides a list of the groups in a table 770 having the followingcolumns: 1) the user defined name for the group which can be modified;2) the list of devices that make up the group, and 3) Actions—theactions that can be done on each group.

In FIG. 12E, the home automation group screen may enable the user toedit an existing group. The content area may display the current groupname and the list of devices 772. The user can use inline editing tochange the group name. An Add Device drop-down menu 773 allows the userto select a new device to add to the list. When the user clicks on theadd icon, the device will be added to the list of devices that displaythe names of the devices. The actions column allows the user to delete adevice from the list. When the user clicks on the delete icon, the userwill be prompted to confirm the delete operation. The user may changethe group settings and select an Update button to modify the group orselect the Cancel button to return to the list of groups screen.

As shown in FIG. 12F, via home automation screen 750 a user may view andcontrol one or more scenes created by the user upon selection of thescenes menu option 758. Generally, upon selection of the scenes menuoption 758, the total number of scenes, for example, is displayed viathe list 775 shown in FIG. 12F. An icon is displayed to enable the userto add a new scene to the list via functionality implemented via theexample GUI shown in FIG. 12G. When the user selects the add icon, thenew scene screen may be displayed. The content area 775 lists the scenesin a table with the following exemplary columns: 1) the user definedname for the scene. The user can modify the name by using inlineediting; 2) the schedule to activate the scene, if defined; 3) thecurrent status of the scene, e.g., either On or Off. The user can clickthe icon to toggle the status of the scene; and, 4) the actions that canbe performed on each scene.

In FIG. 12G, the home automation group screen may enable the user toedit an existing scene. The content area 777 displayed may present thecurrent scene name and schedule. The user may utilize, for example,inline editing to change the scene name, e.g., “morning”, change thescene settings and/or select the Update button to modify the scene. Theuser may select the Cancel button to return to the list of scenesscreen.

As shown in FIG. 12H, via home automation screen 750 a user may view andcontrol all of the events generated by the gateway appliance. In theexemplary screen display shown in FIG. 17H, the total number of eventsmay be displayed. An icon may be displayed to allow the user to add anew event to the list. When the user selects the add icon, a new eventscreen is displayed for user configuration. The content area lists theevents in a table 778 with the following columns: the user defined namefor the event; the automation event; the scene to be invoked for theevent. A hyperlink may be provided to the scene screen; the currentstatus of the event, e.g., either On or Off. The user may test the eventmapping by selecting the icon to toggle the status of the scene; and,the actions that can be done on each event.

As shown in FIG. 12I, the home automation group screen may allow theuser to edit an existing event. The content area displays a list 779providing the event name, automation event and scene. The user may, forexample, use inline editing to change the scene name, or change theevent settings and select the Update button to modify the event. Theuser may select the Cancel button to return to the list of eventsscreen.

Program aspects of the technology may be thought of a “products,”typically in the form of executable code and/or associated data forimplementing desired functionality, which is carried on or embodied in atype of machine readable medium. In this way, computer programinstructions may be provided to a processor of a general purposecomputer, special purpose computer, embedded processor or otherprogrammable data processing apparatus to produce a machine, such thatthe instructions, which execute via the processor of the computer orother programmable data processing apparatus, so as to implementfunctions described above.

Terms regarding computer or machine “readable medium” (or media) as usedherein therefore relate to any storage medium and any physical orcarrier wave transmission medium, which participates in providinginstructions or code or data to a processor for execution or processing.Storage media include any or all of the memory of the gateway device orassociated modules thereof or any of the hardware platforms as may beused in the service management center, such as various semiconductormemories, tape drives, disk drives and the like, which may providestorage at any time for the software programming. All or portions of thesoftware may at times be communicated through the Internet or variousother telecommunication networks. Such communications, for example, mayenable loading of the software from one computer into another computer,for example, from the updater 51 a hardware platform for a gatewaydevice 10 or from another source into an element of the servicemanagement center 50. Thus, another type of media that may bear thesoftware elements includes optical, electrical and electromagneticwaves, such as used across physical interfaces between local devices,through wired and optical landline networks and over various air-links.The physical elements that carry such waves, such as wired or wirelesslinks, optical links or the like, also may be considered as mediabearing the software. Hence, the broad class of media that may bear theinstructions or data encompass many forms, including but not limited to,non-volatile storage media, volatile storage media as well as carrierwave and physical forms of transmission media.

Those skilled in the art will recognize that the teachings of thisdisclosure may be modified, extended and/or applied in a variety ofways. An extension of the system architecture, for example, provides theability of various and disparate third-party application serviceproviders to provide multiple application services independently.Application services are managed by the “managed” service providerthrough the service management center 50, meaning, generally,authorizing, provisioning, and monitoring the usage of a particularapplication service. This can be accomplished in a variety of ways withvarying degrees of involvement of, or coordination with, the servicemanagement center. The service management center 50 could manage theseitems “soup-to-nuts” or have minimal involvement. For example, theservice management center 50 could deal directly with the third-partyservice provider to acquire application services at the request of auser and manage the delivery, authorization, usage-monitoring andupgrading of the application service. At the other end of the spectrum,the managed service provider may have arrangements with the third-partyapplication service provider by which orders or requests from the usersmay come directly to the third-party application service provider, andservices are delivered to the user by the third-party service providerwho in turn coordinates with the managed service provider to registerand monitor the particular application service placed in the gatewaydevice 10. It should be noted that this ability to manage applicationservices extends through the gateway device into the endpoint devicesregistered or associated with the gateway or network.

While the foregoing has described what are considered to be the bestmode and/or other examples, it is understood that various modificationsmay be made therein and that the subject matter disclosed herein may beimplemented in various forms and examples, and that the teachings may beapplied in numerous applications, only some of which have been describedherein. It is intended by the following claims to claim any and allapplications, modifications and variations that fall within the truescope of the present teachings.

1. A gateway and digital media device communicatively coupled to atelevision display for operation in association with the gateway andmedia device at a user premises to provide a dynamic graphical userinterface enabling user access to media from at least one media sourceand application services from the gateway and digital media device,comprising: at least one interface configured to receive a media signalfrom a media source for management by the gateway and digital mediadevice for ultimate presentation via end user devices including at leastone television display and to enable bi-directional communicationsbetween the gateway and digital media device and end user devices,wherein the gateway and digital media device, which is independent fromthe media source, is configured to provide application serviceinformation from a service provider over a wide area network to end userdevices via the gateway and digital media device and a user premisesdata communications network, wherein the application service informationincludes notifications of status regarding applications services; and aprocessor coupled to the at least one interface, wherein the processoris configured to form a composite signal from the media signal andapplication service information from the gateway and digital mediadevice, wherein the composite signal comprises a composite image on theat least one television display representing media obtained via the atleast one interface and application services provided via the gatewayand digital media device, and wherein the processor enables dynamicaddition or removal of graphical icons in cooperation with the gatewayand digital media device and the service provider as determined bysubscriptions to at least one of media applications, servicesapplications, and media sources connected to the gateway and digitalmedia device; wherein the gateway and digital media device providesgraphical interaction simultaneously with media and service distributionsystems via a dynamic graphical user interface displayed on the at leastone television display and input received in the form of a selectionsignal from a remote control based on the displayed image, whereingraphical interaction via the dynamic graphical user interface includesaccess to an arrangement of graphical icons displayed on the televisiondisplay and represent identification of media applications, serviceapplications, and media that is selectable to generate the selectionsignal when highlighted, and wherein the selection signal is transmittedvia the user premises data communications network to the gateway anddigital media device or to the media source to enable the execution ofprogramming embodied on the digital media device to provide at least oneof: a service application provided via a user premises datacommunication network and media from a media source connected to thegateway and digital media device via the at least one interface.
 2. Thegateway and digital media device of claim 1, wherein the datacommunications link in the user premises comprises a user premises datacommunications network.
 3. The gateway and digital media device of claim1, wherein the at least one interface is configured to receive the mediasignal from one or more media sources.
 4. The gateway and digital mediadevice of claim 1, wherein the at least one interface is configured toreceive the media signal from one or more analog video sources or one ormore digital video sources.
 5. The gateway and digital media device ofclaim 1, wherein the at least one interface is configured to receive themedia signal from a cable television signal source, a satellitetelevision signal source, a television broadcast signal source, an audiosignal source, a video playback device, or a game console, or anycombination thereof.
 6. The gateway and digital media device of claim 1,wherein the media signal of the composite signal forms a primary image,and the application service information of the composite signal forms asecondary image, wherein the at least one television display isconfigured to display the secondary image overlaid on or inserted intothe primary image to form the composite image.
 7. The gateway anddigital media device of claim 1, wherein the application serviceinformation of the composite signal forms a primary image, and the atleast one media signal forms a secondary image, wherein the at least onetelevision display is configured to display the secondary image overlaidon or inserted into the primary image to form the composite image. 8.The gateway and digital media device of claim 1, wherein the compositesignal further comprises an audio signal from the application serviceinformation or the media signal, wherein the audio signal provides audiosubstantially contemporaneously with the composite image on thetelevision display.
 9. The gateway and digital media device of claim 8,wherein the processor is configured to form the audio signal as acomposite of audio of the media signal and audio information of theapplication service information.
 10. The gateway and digital mediadevice of claim 1, further comprising a digital storage device coupledvia a data communications link with the processor, wherein the digitalstorage device is configured to record the media signal received by theat least one interface or record the media signal received by the atleast one first interface.
 11. The gateway and digital media device ofclaim 10, wherein the digital media device receives a selection signal,wherein the digital media device records the media signal, theapplication service, or the media signal and the application serviceupon receipt of the selection signal.
 12. The gateway and digital mediadevice of claim 11, wherein the selection signal is a pause media signalor a record signal.
 13. The gateway and digital media device of claim 1,wherein the processor is configured to synchronize the media signal andthe application service information to form the composite signal. 14.The gateway and digital media device of claim 1, wherein the processoris configured to filter at least a portion of the media signal, or theapplication service information, or the media signal and the applicationservice information to form the composite signal.
 15. The gateway anddigital media device of claim 1, wherein the gateway and digital mediadevice is further configured to; provide and manage services of one ormore endpoint devices including at least one of home automation andsecurity equipment associated with the gateway and digital media device;receive status information from the endpoint devices connected to andmanaged by the gateway device for display by the digital media device onthe television display and to provide user selection signals from thedigital media device to control the endpoint devices via the gatewaydevice; and enable graphical interaction including the arrangement of atleast one set of graphical icons displayed on the viewer alsorepresenting at least one endpoint device managed by the gateway devicetogether with the least one of a media application, a serviceapplication, and media that is selectable by a user to generate theselection signal when highlighted via the remote control.
 16. Thegateway and digital media device of claim 1, wherein at least one of theendpoint devices is a security system including video cameras and thegateway device is further configured to provide video from the securitysystem for viewing via the digital media system on the televisiondisplay.
 17. The gateway and digital media device of claim 1, whereinthe gateway and digital media device is further configured to: provideand manage services of one or more endpoint devices including at leastone of health monitoring equipment associated with the gateway anddigital media device; receive status information from the endpointdevices connected to and managed by the gateway device for display bythe digital media device on the television display and to provide userselection signals from the digital media device to control the endpointdevices via the gateway device; and enable graphical interactionincluding the arrangement of at least one set of graphical iconsdisplayed on the viewer also representing at least one endpoint devicemanaged by the gateway device together with the least one of a mediaapplication, a service application, and media that is selectable by auser to generate the selection signal when highlighted via the remotecontrol.
 18. The gateway and digital media device of claim 1, whereinthe endpoint device is a health monitoring system including sensors forpatient monitoring.
 19. The gateway and digital media device of claim 3,wherein the endpoint device is a health monitoring system includingsensor and the gateway and digital media device is further configured toobtain readings from the sensors.
 20. A media and service distributionsystem for a user premises having access to a media source to obtain amedia signal and supply it to end user equipment over a user premisesdata communications network, comprising: a gateway and digital mediadevice for operation at the user premises, independent of the mediasource, configured with media resource management functionality toreceive an application service from an application service provider viaa wide area network, and further configured with gateway functionalityto provide and manage services to one or more endpoint devices includingat least one television display associated with the gateway and digitalmedia device, said gateway and digital media device communicativelycoupled to the at least one television display and programmed to providea composite image including graphical interaction enabling user accessto media, application services, and application service information viaa dynamic graphical user interface; at least one interface configured tocommunicate with a wide area network to receive the media signal fromthe media source for presentation via the television display and tocouple the gateway and digital media device to the user premises datacommunications network, wherein the gateway functionality of the gatewayand digital media device is further configured to manage provision ofthe application service and application service information obtainedfrom the wide area network for the media resource managementfunctionality of the gateway and digital media device, and wherein theapplication service information includes notifications of statusregarding applications services managed by the gateway device; and aprocessor coupled to the at least one interface and configured to: (i)form the composite signal from the media signal and application serviceinformation, wherein the composite signal comprises a composite imageincluding the dynamic graphical user interface rendered on thetelevision display, wherein the gateway and digital media deviceprovides graphical interaction with media and service distributionsystems via the dynamic graphical user interface displayed on thetelevision display and input received in the form of a selection signalfrom a remote control based on the displayed image, wherein graphicalinteraction includes an arrangement of at least one set of graphicalicons displayed on the television display that represent identificationof at least one of a media application, a service application, and mediathat is selectable to generate the selection signal when highlighted,and wherein the selection signal is transmitted via the user premisesdata communications network to the gateway and digital media devicethrough the at least one interface or to the media source to enable theexecution of programming embodied on the gateway and digital mediadevice to provide at least one of: a service application and a selectedmedia application from a media source connected to the gateway anddigital media device, and (ii) dynamically add or remove graphical iconsin cooperation with the gateway and digital media device and the serviceprovider as determined by subscriptions to at least one of mediaapplications, services applications, and media sources connected to thegateway and digital media device.
 21. The system of claim 20, whereinthe gateway and digital media device is communicatively coupled to aservice management center via the wide area network, and wherein theservice management center is configured to provide the applicationservice to the gateway and digital media device via the wide areanetwork responsive to a communication from the service managementcenter.
 22. The system of claim 20, wherein the first interface isconfigured to receive the media signal from one or more media sources.23. The system of claim 20, wherein the first interface is configured toreceive the media signal from one or more analog video sources or one ormore digital video sources.
 24. The system of claim 20, wherein the atleast one interface is configured to receive the media signal from acable television signal source, a satellite television signal source, atelevision broadcast signal source, an audio signal source, a videoplayback device, or a game console, or any combination thereof.
 25. Thesystem of claim 20, wherein the media signal of the composite signalforms a primary image, and the application service information of thecomposite signal forms a secondary image, wherein the television displayis configured to display the secondary image overlaid on or insertedinto the primary image to form the composite image.
 26. The system ofclaim 20, wherein the application service information of the compositesignal forms a primary image, and the at least one media signal forms asecondary image, wherein the television display is configured to displaythe secondary image overlaid on or inserted into the primary image toform the composite image.
 27. The system of claim 20, wherein thecomposite signal further comprises an audio signal from the applicationservice information or the media signal, wherein the audio signalprovides audio substantially contemporaneously with the composite imageon the television display.
 28. The system of claim 27, wherein theprocessor is configured to form the audio signal as a composite of audioof the media signal and audio information of the application serviceinformation from the gateway device.
 29. The system of claim 20, whereinthe application service information from the gateway device comprisesnotifications of status with regard to one or more application servicesmanaged by the gateway device.
 30. The system of claim 26, wherein theprocessor is configured to receive the notifications of status from thegateway device and transmit a message related to the selection signal tothe gateway and digital media device via the user premises datacommunications network, using a presence and networking protocol. 31.The system of claim 20, further comprising a digital storage devicecoupled via a data communications link with the processor, wherein thedigital storage device is configured to record the media signal receivedby the at least one interface or record the media signal and theapplication service received by the second interface.
 32. The system ofclaim 31, wherein the digital media device receives a selection signal,wherein the digital media device records the media signal, theapplication service, or the media signal and the application serviceupon receipt of the selection signal.
 33. The system of claim 32,wherein the election signal is a pause media signal or a record signal.34. The system of claim 32, wherein the gateway device further comprisesa digital storage device configured to store at least one of mediasignals, application services, application service information and mediasignal recorded by the digital media device and communicated to thegateway device from the digital media device via the wide area network.35. The system of claim 20, wherein the processor is configured tosynchronize the media signal, and at least one of the applicationservice and the application service information to form the compositesignal.
 36. The system of claim 20, wherein the processor is configuredto filter at least a portion of the media signal, or the applicationservice information, or the media signal and the application serviceinformation to form the composite signal.
 37. The gateway and digitalmedia device of claim 20, wherein the gateway device is furtherconfigured to: provide and manage services of one or more endpointdevices including at least one of home automation and security equipmentassociated with the gateway and digital media device; receive statusinformation from endpoint devices connected to and managed by thegateway and digital media device for display by the digital media deviceon the television display and to provide user selection signals from thegateway and digital media device to control the endpoint devices via thegateway and digital device; and enable graphical interaction includingthe arrangement of at least one set of graphical icons displayed on theviewer also representing at least one endpoint device managed by thegateway and digital media device together with the least one of a mediaapplication, a service application, and media that is selectable by auser to generate the selection signal when highlighted via the remotecontrol.
 38. The gateway and digital media device of claim 20, whereinthe endpoint device is a security system including video cameras and thegateway device is further configured to provide video from the securitysystem for viewing via the digital media system on the televisiondisplay.
 39. The gateway and digital media device of claim 36, whereinthe endpoint device is a security system including video cameras and thegateway and digital media device is further configured to provide videofrom the security system for viewing via the digital media system on thetelevision display.
 40. The gateway and digital media device of claim20, wherein the endpoint device is a health monitoring system includingsensors for patient monitoring.
 41. The gateway and digital media deviceof claim 20, wherein the gateway device is further configured to:provide and manage services of one or more endpoint devices including atleast one of health monitoring equipment; receive status informationfrom endpoint devices connected to and managed by the gateway anddigital media device for display by the digital media device on thetelevision display and to provide user selection signals from thegateway and digital media device to control the endpoint devices via thegateway and digital device; and enable graphical interaction includingthe arrangement of at least one set of graphical icons displayed on theviewer also representing at least one endpoint device managed by thegateway and digital media device together with the least one of a mediaapplication, a service application, and media that is selectable by auser to generate the selection signal when highlighted via the remotecontrol.
 42. A media and service distribution system for a user premiseshaving access to a media source to obtain a media signal and supply itto end user equipment over a user premises data communications network,comprising: (a) a gateway and digital media device for operation at theuser premises, independent of the media source, configured with mediaresource management functionality to receive an application service froman application service provider via a wide area network, and furtherconfigured with gateway functionality to provide and manage services toone or more endpoint devices including at least one television displayassociated with the gateway and digital media device, said gateway anddigital media device communicatively coupled to the at least onetelevision display and programmed to provide a composite image includinggraphical interaction enabling user access to media, applicationservices, and application service information via a dynamic graphicaluser interface; at least one interface for enabling bi-directionalnetwork layer communications within the premises and configured toreceive the media signal from the media source for presentation via thetelevision display, for enabling bi-directional network layercommunications for the one or more endpoint devices via a wide areanetwork, and for enabling at least some bi-directional communicationswith a service management center external to the premises via the widearea network; the gateway and digital media device coupled to the userpremises data communications network, wherein the gateway functionalityof the gateway and digital media device is further configured to manageprovision of the application service and application service informationobtained from the wide area network for the media resource managementfunctionality of the gateway and digital media device, and wherein theapplication service information includes notifications of statusregarding applications services managed by the gateway and digital mediadevice; a processor coupled to the at least one interface, wherein theprocessor is configured to: (i) form the composite signal from the mediasignal and application service information, wherein the composite signalcomprises a composite image including the dynamic graphical userinterface rendered on the television display, wherein the gateway anddigital media device provides graphical interaction with media andservice distribution systems via the dynamic graphical user interfacedisplayed on the television display and input received in the form of aselection signal from a remote control based on the displayed image,wherein graphical interaction includes an arrangement of at least oneset of graphical icons displayed on the television display thatrepresent identification of at least one of a media application, aservice application, and media that is selectable to generate theselection signal when highlighted, and wherein the selection signal istransmitted via the user premises data communications network to thegateway and digital media device or to the media source to enable theexecution of programming embodied on the gateway and digital mediadevice to provide at least one of: a service application and a selectedmedia application from a media source connected to the gateway anddigital media device, and (ii) dynamically add or remove graphical iconsin cooperation with the gateway and digital media device and the serviceprovider as determined by subscriptions to at least one of mediaapplications, services applications and media sources connected to thegateway and digital media device; storage coupled to the processor; andprogramming in the storage for a plurality of application services,wherein for each application service, execution of the programming bythe processor causes the gateway and digital media device to providefunctions in relation to a respective service for one or more endpointdevices.
 43. The system of claim 42, wherein the programming comprises:logic for a plurality of application services; logic for interfaces forthe application services, including at least one television interfacefor implementation on the at least one television display through thedigital media device; logic for a services framework; and logic forplatform management.
 44. The gateway and digital media device of claim42, wherein the endpoint device is a security system including videocameras and the gateway device is further configured to provide videofrom the security system for viewing via the digital media system on thetelevision display.
 45. The gateway and digital media device of claim43, wherein the logic is for a security system including video camerasand the gateway and digital media device is further configured toprovide video from the security system for viewing via the digital mediasystem on the television display.
 46. The gateway and digital mediadevice of claim 43, wherein the endpoint device is a health monitoringsystem including sensor and the gateway and digital media device isfurther configured obtain readings from the sensors.
 47. The gateway anddigital media device of claim 43, wherein the logic is for a healthmonitoring system and the gateway and digital media device is furtherconfigured to obtain reading from sensors used in monitoring a patient.